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< This publication will help high school and 
students develop policy analysis skills and techniques and 
these to important public issues. A public policy issue is 
•a disagreement between 9 two or more elements of a society over 
that the society's government deals with a* given 
'six chapters. Chaptter one deals with the bas^ic concepts -netfessajry to 
analyze public policy issues. Discussed are organizing information p 
and values oa public policy issues and types of public policy 
analysis including monitor^ng^f orecastlng, evaluation, and 
prescription. Chapters t*ta»and three discuss the acquisition bf 
information necessary forthe analysis. Chapter two ^explores the use, 
'of many different %ata sources valuable in acqu'^ing .information 
including dictionaries and encyclopedias, jo^rnal^rticles , almanacs', 
'newspapers, government documents,, arid microforms*. ,Chdpter three deals 
. with surveys ■ and interviews. Chapter f our explores, ,the application of 
descriptive statistics in the analysis of/fcublic policy issues. 
Chapter five concerns benefit-cost analysis of proposed public policy 
issues and the use of scientific and quasi-scientific research - 
designs in the analysis of public policy. 'The concluding chapter 
discusses the Prince Political Accounting System which is a technique 
for assessing the impact of various 'individuals ; £t^uj>s,,and % 
organizations on public policy decisions. (RM) 
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Policy Studies Associates was established iji 1976 jfeo strengthen , . 
learning resources in order, to help students develop policy analysis 
skills and techniques and amply (these 4 to "import an V public issues. ' -» 
Toward this end, two ser<ies^of learning packages have been published, 
designed especially for undergraduate usei — ^Policy Sciences Series , 
which emphasizes techniques ill policy analysis, and Policy Issues * 
Series, - whdch. concentrates' on specific pubxic* policy questions. 

An^op6rating program of the Council on international sfnd Public * 
Affairs, ^Policy Studies Associates is a cooperative nonprofit under- 
taking of v a small group of faculty- members and others concerned with 
iippjoving the quality of education on public policy issues iti schqpls 
colleges, and universities.** * 
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INTRODUCTION; A- FRAMEWORK FOR STUDY 

* 9 

• • • * y 

t » 1 
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f ^ ' - - • 

A"public policy issue is a 'disagreement between two or more 
elements of- a society oyer^he way^ that the society's government ' 
deals with a given condflt ion .. (The' disagreement may be-6n how X he; • 
government is actually tieaTing with the condition, or how It, should, 
dea'l with the condition! •) _There NMje three essential criteria derived 
from this definition which determMe whathef' or ' not a public policy 
issue existsi • • °" . r- 

1. Disagreement * between identifiable, elements of the 'society-. * 

/ 2. Societal conditions af f eeting^the society within which- 
the disagreement exists. " \ * - 

« . t , * '. • " " " 

' 3.'- Governmental .action , that will either occur or pe seriously 
•considered in. order to de.al with the condition. 



( ■ , ' ■ 

Consider the' following three situations*. .Each of them contains 
j one -element qf our definition, 'but none .contains all of the three 




reauired 1 or class! f icationt as a.n issue. 

1. Citizens of CoJLumbus, Ohio accepf a slight increase in 
► . thei*r property taxes. > •• 

2. The mayor of Chicago, Illinois runs f or Te-^lectidn. 

3. A sparse rainfall in parts ^of two Southern st&tes creates 
.hardship for many farmers. . ^ A * * / . 

Raising property ^axes in Columbus, Ohio cdnstittites government 
action dealing with a sobietal condition. But* without any disagree- 
ment over the decision, it does not become a public- issue. A^mayor's • 
re-election campaign may involve disagreement among important ele 7 " 
ments of the city's voting public regarding the governmental actions 

xt 12 



;that will^ffeiLow tasa consequence of the election results. However, 
tiie election itselrsd^es not represent a "societal condition. " 
Finally, the- low rainfSall Indicates * a societal cdnditionland some \ 
desire for, action on the 1 p£rt of those tfWmers. affected, but no wide- 
spread disagreement ; in such 4 a qase N the likelihood of governmental 
involvement *is extremely low." 

Of course, any of the three incidents could evolve into -a public 
policy issue. To illustrate, we have changed the foregoing situations 
so th^t they satisfy the three criteria for, being considered as public 
policjrSrssues. ■■/••' 

1. ' M&ny citizens*bf 'Columbus opjtfase the proposed , 

increase. in prQperty taxes. f 

• / ■ * I 

2. The mayor has declared that his re-e\iection will 
signify suppoff for a policy of extensive urban $ * ^ 
renewal in alf* decaying urban areas. His opponents 
oppose him primarily on this declaration.' 

3. Federal or State governmental' aid is requested to 
assist the farmers -affected by the drought. 

The point is that only when all --three characteristics occur simul- • 
taneously can we say a public issue exists. 
• * ^ 

Recognizing th,e circumstances constituting a'particular public 
policy issue is only the first step, in comprehending that issue. It 
doesn't tell us frhy the issue has dev^l&ped; it doesn^t tell us the 
factors instrumental in' predict ing the outcome of the 4 issue. To 
achieve these things — either as officials .responsible for action or- 
as effective observers and critics — we need to organizes great 
deal of information on^he 'issue, to understand the values underlying 
its development, and t(3"#nalyze the' information in the context otf 
the values. . , , 

j- 

This learning package provides a framework through which these 
tasks can be completed. It is divided into six* chapters. Cha^ltt^ 
One d^als witK the basi.c concepts 'necessary to -analyze p.ublic policy 
yissues. Chapter Two and Chapter Three' concern^ the acquisition of 
information necessary to the analysis. Chapter Two ''explores the use 
of many diff erent *data* sources valuable in' acquiring information. 




cerns benefit-cost analysis of proposed public policies, a valuafcLe 
skill in decision making and evaluation o'f public policies*, and the 
use of scientific and quasi-scientific research designs in the 
analysis of public policy. ' Chapter Six, the PRINCE System, gives a 
method for predicting the outcome of the issue- and strategies lor 
changing the predicted outcome. ; j ^ *p 



e Chapters One through Four are based on the Policy Studies 
Associates learning packages in the "Policy Sciences Series M : PS-17, 
Analyzing Public- Policy Issues ^ PS-19, Library Research for the 
Arlalysis of Publ/ic Policy ; /PS- 12, Introduction to' Surveys and, Inter- 
views ; and PS-20, Descriptive Statistics for Public Palicy Analysis , 
Chapter Five is in part based on FS-11 Designs for Evaluating 
So<5ial Programs , and a forthcoming learning package on benefit-costs • 
Chapter 'Six -is adapted from Everyman's PRINCE r A fluide "fo Under^ , 
standing Your Political Problems . ' • 
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CHAPTER ONE; ANALYZING PUBLIC POLICY ISSUES 



THE PRIMARY OBJECTIVE: 

This chapter will introduce you to the basic concepts 
necessary to analyze public p'olicy. 



UPON COMPLETION OF THIS CHAPTER, YOU WILL BE ABLE T.O: 

* Identify the elements of public policy issues within a 
framework that will enable you to formulate specific 
research tas£s. • , n 

* Examine the role of public/ interest and special interest 
values in the analysis of public policy issues, 

* Indicate the role of monitoring, forecasting, evaluation, 
and prescription in the analysis of public policy issues. 



(Based on PS-17: Analyzing afiblic Policy Issues , William D. Coplin 
and Michael K. U'Leary, Croton-on-Hudson/ NY: Policy Studies 
Associates, 1978.) - 



\ 
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I: ORGANIZING INFORMATION ON PUBLIC POLICY ISSUES 



Analyzing public policy, rssues involves dealing with two 
questions, which, though interconnected, are not the same. Public 
and privat-e discussion of public policy frequently blurs these two 
questions, 'thereby ponfusing the 'discussion and analysis of public — 
policy. Therefore, we want ^to^begin our analysis by aist ingui^h- m 
ing between the two. - , 

• \ • • ' ■ ' • 

The first question is: - 

* 

What are the effects, both intended and unintended, , . 

% of actual policies on various conditions in society? 

t 'r 

. The second* question is*: 

Why are centain policies established, while others 
'are defeated, or hot even considered at all? 

5 1 

• , The first question addresses the problem of evaluating the 
Effects of public policy. Does a given decision have desirable 
or undesirable results — or* no results at all? Are, all of these 
results anticipated, or, as it often happens, does policy produce 
some' unexpected effects on society? The second ■ quest ion addresses 
the' problems' of the "politics of 'public policy." In other woi^, 
how do' individuals and groups cooperate and compete in ord^r to 
support and oppose alternative policies? ^ » 

These two, questions have a long endurance, .'stretching back 
in relevance to the American Revolution of 200 years ago. In the 
first place, a sufficient humber of influential colonists had to 
decide they wanted to pursue the policy of independence,* 3>s opposed 
to other alternatives, such ;as trying to exert reformist pressure 
on their British overlords. For a long tirrife, many Americans ■ , 
favored the latter "course,. The promulgation of the Declaration of 
Independence in 1776 by no means signified unanimous 'agreement 
that independence was the proper policy to follow. 

Gd~ven a decision to declare independence, >the second considera- 
tion was what effects would 'this have on the social, political, 
and economic Jives of the Americans living in the former colonies?' 



' -A 



■■■■■MM 



And indeed, in tfce early war years, it was an open question whether 
the decision for independence would be able to tajce effect mili- 
tarily, or if it would result in continued (or even increased) 
control by* Great Britain — just the opposite of what wa's intended. 



A. The Basic Framework: Environment, Actors, Policies 

To organize-'.information so that these two questions aan be* 
explored, we have found it helpful to use the classification scheme 
•portrayed below: 



Figure 1.1: Basic Categories for Organizing 

Information oA Public Policy Issues 



Political Actors 



1 Policy Environment! 4: 



t Public Policies 1 



s 



1 

The figure suggests that it is njfcessary to obtain informa- 
tion on three specific components. * First, we must consider the - 
policy environment comprising thes.e societal conditions that 
motivate political actors >and serve as the targets ^f public 
policies. Secondly, we should be concerned with political actors , 
.that i6, individuals and groups that attempt to influence public 
policies. Finally), we are concerned with information regarding 
governmental laws and activities that collectively compose public 
policies . Table 1 . 1 provides .examples of how one might apply the 
three categories to a variety of public policy issues. 



Since the three te 
and public policies — 
developed from our defi 
policy issue, it should 
three aspects. Moreove 
M A- ,f and "B", represent 
this chapter. Once inf 
desdribe the policy env 



rms — policy environment,, political actors, 
are synonomoifs with the^ three criteria 
nition, we know that if there" is a public 
be possible to obtain information on all 
ir, the two arrows in the diagram, arrows' ' 
the two questions posed at the outset of 
ormation has been gathered and organized to 
ironment, the political actors, and the 
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TABLE 1.1? Examples of Public^fo] iey Issues 



Pdlicy Environment 



Political Actors 



Public Policies 



Inflation 



Traffic 'Congestion 

Poor Education in 
^mrban Areas 



Overcrowded Oails 



Consumers, Businessmen , 
Labor,' Government 
Officials 

Drivers, Taxpayers, 
Government Officials 

-Parents, Local SchBol 
Officials, State School 
Officials 

Oil Companies, Consumers, 
Oil-Producing Countries 



Income- Tax Levels 



Tariff on Oil 
Imports 

Bail *Bond Regulations, 
Parole Policies 



*Uhere blanks, appear , yojj are invited to supply your own examples. 



public policies, it is then possible to explore the question of (30 

the impact of the policies on the society (arrow tt A ,t ) and (2) the 

pressures' of political actors on the public policies (arrow M B I! ). 

The third portion of this chapter introduces procedures of analysis 

that can be employed for each of these questions. For the present, 

it is only necessary to make distinctions implicit in the diagram* 

* * ■ 

The classic document of the Ameripan revolution, the Declara- 
tion^ o^Independence , clearly pW&ents information classifiable • 
into these three categories. The actors include most prominently, 
of course, ffing George III 'of Great Britain. Other important 
actors mentioned are .the Governors of the colonies who were 
subservient to the King, and his ministers. in the homeland. The 
Declaration also directs a good deal of attrition to the legisla- 
tures rendered impotent by the' King, and colonial judges who 
interpret the law in what the signers felt was an unfair and - 
tyrannical fashion. Finally, there "is a guarded reference to the' 
British citizenry and parliament: # "...nor have We been wanting / 
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in attentions to our Brit ish 'brethren , " continltiELg with, n We have 
warned them from time to time of attempts by theii^ie^islature ; . . M 
Assertively, the Declaration took its message direct ly>Q^the King. 

' * The Declaration' also provides a long list of policies whict 
these actors have followed. , These include: ' the King's refusal 
to' "... Assent to Laws, the most wholesome and necessary for the 
pub.lic good..."; alternative dissolution or calling of secret 
legislature sessions "-..for the sole purpose of fatiguing them into 
compliance with this measures'..."; restriction of immigration into 
,the colonies and prevent ion" of people already in the colonies from 
becoming citizens; and ttie quartering of . large bodies of. armed 
troops among us...," whose interaction with the citizens suffered 
little, judicial restraint . 



• r \ The, environment most- prominent in the Declaration is, of course, 
the conditions in the colonies affected by these- policies. The 
elements mentioned include, in the first instance, the repeated 
weaknesses of the Representative Houses, brought about by the 
policies of the King. Through this -act, the King gtifled the 
colonists 1 opposition to "...his invasions on the rights of the 
people. " Other affected environmental conditions* included the 
personal safety and security of the peoples in the colonies, which 
were frequent!^ threatened by the King's armies; and,* of course,, 
the economic wealth of the colqpnists jeopardized by restrictions 
on foreign trade and by the imposition, o,f "...taxes on us without 
our consent." 



B. Summary 

To summarize, it is necessary to classify the information ) 
relevant to a public policy issue. The suggested classification m 
-* requires that the following questions be answered: 

* -a) What is the public policy? 

b) What is the policy environment? ^ 

c) Who are the political actors? 

d) What influence do the actors exert on the policy? 

e) What impact'* does the policy have on the environment? 
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EXERCI.SE 1.1: Applying the Framework to a Public, Pol Ley Issue 

Select three news^ articles from the- Nfew^ork Times which con- 
tain thej criteria for public policy issues as outlined in this 
section.^ For each article, list 2 the following items as they 
pertain to your, article-: 

' a) \Environment 



b) Actors 

.\ 

c) Policy 

d) Arrow M A' 

e) ^Arrow "B" 





IT: ORGANIZING VALUES ON PUBLIC POLICY ISSUES 



The driving force behind all public policy issues- is the 
conflict between individuals and 'groups over conditions existing 
in the society and possible governmental remedies. .Conflict 
arises due .to the differing valjies held by groups or individuals- 
Consequently, most 'inf ormationron public policy issues is imbued 
with the values of those responsible for the gathering and pre- g 
sentatiJn of t£e information. , . 

w ■ % • 4' * . ■ 

Far. that reason,, it is very important in T>rganizin'g the 
value dimension of public policy issues to. separate faces frpm 
meaning of, and relationship between, values and factg. However, 
for our purposes, a factual statement can be defined as, one 
^describing or predicting, conditions or events, *&nd a value state- 
ment as one rendering a positive or negative judgement about a 
particular condition or event. 
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-At the outset, one guide to making the distinction betweeu' 
facts and values ife through examining 'the verbs used, in a given 
statement. If. a itatemeht contains* vettbs like "is" # or. "a're* / 
or "will 'be," it is a actual statement. If the statement contains 
verbs like "should" or "ought to," it ijs value statement* Unfor- 
tunately, those people likely, to make statements on publq^spolifcy 
issues are frequently unclear about the t distinction betweefc^yalues 
and facts. The rhetoric underlying most public" gplJLcy .issue 
discussion and analysis frequently vf alls to make th l^ critical , 
distinction. . V 

ffhe Declaration contains many, statements asserted as fact,; but 
which are actually value claims of the leaders of the American , 
Resolution. The statement "[that]' to secure these rights, govern- 
ments ,are* i&stituted among men," reflects a value judgement, not 
an 'expression of fact. • Governments, are instituted -for many differ- 
ent reasons, not all, of them nearly as noble as those claimed in 
the Declaration. This is. a -common tactic in, policy rhetoric.: ■ 
.Therefore, you must look beyond grammatical construction to analyze 
a statement.* One good rule of thumb is: Can the ^statement be^ 
tested with sortie available evidence? If it can, it is a factual 
statement 'Ceven though it may turn out to be untrue in the light of 
such evidence). If, on the other hand, it cannot be tested wjfth 



evidence, 'as the statements quoted 'aboVe from the Declaration, then 
it is a value statement/ . , *+ t 



^However difficult to. carry oQ& k *fhe distinction between faclfs 
and .values ' should be* maintained ,if analysis cxf public policy 
issues is to be a useful enterprise. .^Thi* «Wi*ir become apparent when 
- we discuss -the types of policy analysis,* ? 5 0 - ; * • 

For the remainder* of this section,, we will introduce value : 
^ cansicjerations typically underlying ptibiic poJLiQy issues.. Basically, 
two types can be identified — those* classified, as self-in£ ere^t and 
those classified as part *of< a larger cono.er'n^f or. the society as a '* 
whole.. Both typ^^;^rvade most public policy, issues. 
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A. Self-interest }V alues . 

• ■■ * » 

To the degree that basic societal needs, are not satisfied, and 
the perception persists that governmental action can make a differ-' 
ence, those individuals and groups affected' will nat-tempf to^obtain 
policy "decisions ' protective y?f goods and service^ de£ir&d by them. 0 . 
Central city merchants^ lobbying :£or~ improvements in a 'local urban' 
transportation system exemplify such k an effort "\ ^ \ 

It i£ generally the case that the needs-^f individuals &nd 
groups are satisfied. " Governmental inst;itj#tTions attempt to build 
support by serving the needs of their citizens.* They are in the 
business of satisfying needs and usually do^sq. fthen these needs 
are 'satisfied, public policy issues db not aris^e.- However, there 
are occasions when the needs A of groups and individuals are not 
satisfifed, occurring under conditions', in which the govermhentrtself 
is unaware and usually of a temporary nature. f Continued dissatis- 
faction will almfest certainly result in^fbvernment becotaing- aware . 
of the needs of other groups and individuals' may emerge who are 
opposed for one reason or another. " Wheii opposition arises betweln 
groups, publifc issues arise t * ' •* } 



Opposition can be direct or indirect. ftjgect opposition is • 
characterized by two groups or individuals holding contraposit ive 
positions on the same issue, e.g., .groijp A oppdses the demand f or * 
certain services that group B requests. Indirect opposition occurs 
when the demands by one group can only be satisfied. at the expense 
of the satisfaction of demands of another, group. • 

% While ^the Declaration clearly emphasized general public 
interest or societal values, it is not without reference to specific 
values emanating from the self-interest of the colonies. For 
example, the. emphasis on economic questions relating to taxation and 



trade. regulation was motivated. primarily by the feeling by certain 
members of^the colonies that Great Britain was receiving a dis- 
proportionate share of goods . generated by the colonies** There 
was ' a claini/that the x taxes were unjust because they were imposed 
without the consent of the colonies. However, the increased cost 
to the colonies represented by rising taxes was the maejor complaint 
As we shall see, the transformation of statements' originating from 
self-interest into statements based on public interest values is* 
more than a rhetorical trick. 



B. Public Interest Values * 



Frequently, public policy issues commence as conflict's between 
a few groups over their part icular-,-self-interests . However, if 
the issue remains unresolved and t the opposing groups grow more 
adamant and stronger incumbers and po\ver, broader values are 
frequently cited, it. is not always clear whether these broader 
values are raised in order to enlist t\\& support of others not , 
• directly affected by ^self-interest , or : whether-, in fact, the groups 
involved actually feel such values are at stake. At some point, 
however, such societal concerns do become important in almost all 
major public policy . issues . ■ 

It is possible to identify six major public - interest values 
that emerge in one form or another in public policy issues^: 

a) Individual freedom, % • 

b) * Order within the society, * , . * 

c) Equality among individuals f « * 

d) „ r Justice for individuals,. „ . 
• e) Legitimate decision-making process, and 

f) Efficiency of 'government operations. 

' «> « * * * 

A variety of definitions arid interpretations of a public * 
interest value can be cited as'^one reason Vf or the conflict these 
values generate. Individual freedom obviously "does not mean that 
individuals cm do anything they want. They'eannot break the Law 
to satiate individual desire. • Each society has spent vast sums 
of intellectual effort in an attempt to -delimit the .concept of 
freedom, but it is* clear that definitions and applications are 
continually changing.' . 
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The same can be said .for the refining five values: order, 
equality, justice, legitimate decision-making process, and 
governmental efficiency. These terms; appear throughout the history 
of all societies, continually requiring refinement of definition 
and application/, Order connotes the maintenance of existing r% 
community laws and relationships, but no community can exist 
without changing those laws- and relationships. Equality is 
grounded in the concept that each member of the community is equal 
to another member .of the community, but, no society has sucn a 
condition (although sonfe are closer to it than others). Justice 
refers 'to the fair treatment of individuals by the governm^ht , 
others* in the society', or before th^e law, but 'fairness' is a fluid 
concept .and applied erratically. ' Efficiency can be estimated vin 
terms of resources required to accomplish & given objective, but 
the 'soft 1 nature of most objectives make it easy for reasonable 
people to disagree over the expected efficiency of p. given govern- 
mental policy. Finally, everyone agrees that governmental 
decisions should be reached in compliance with those legal and moral 
principles usually associated with the democratic process How- 
ever, few agree on the exact content^ of those principles and their 
application ifi specific situations***, ji • - - # . 

Because it is impossible to formally define and apply these 
five values across all conditions within any given society and 
vvith respect to any given public policy issues, actors frequently 
interpret the values to support -their particular position. On any 
given public policy issue, two opposing groups may find, that the. 
same value leads them to opposing views on the ^issue. For example, 
the freedom of the British and French aviation industry €o land a 
supersonic jSt in the United States during 1976 was perceived bg 
many individuals and* groups as an ' infringement on their freedom 
from excessive noise. Everyone to spme extent values freedom, 
ordet, equality, justice, government efficiency, an<4 legitimate 
procedures as we have defined them, bijt their definitions and 
applications c t6 Concrete public policy issues create the disagree- 
ment that is an inherent part of that issue. , 

* * 
Not only does disagreement .among groups of individuals arise 

because of different interpretations of. the same value; it also 
arises because one value conflicts with another. If all individuals 
werfe free to do what they wanted — including 4Sot paying taxes — 
there would be aa order; individuals would not be equal; jthere 
would be no basis for the fair treatment of everyone; and govern- 
mental operations and decision making would grind to a halt. 
Similarly, orde'r may require a curtailment of individual freedom, 
the .n^iptenance of * the status quo,, and in some extreme cases, the 
elimination of fair t treatment to'specific individuals and groups 
within a society, or the wasteful application of ^resources. Equal 
treatment also may require the^curt ailment of individual freedoms, 
the/ reduction of stability, the abandonment of just procedures, or 
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the adoption of inefficient- methods. Justice for one individual 
may limit the freedom oi the other, the maintenance .of order, the 
reduction of equality of .opportunity; or the slowing down of 
governmental -processes. Policies that are efficient from the point 
of view of achieving specific objectives may reduce freedoms, 
.threaten order, or be inherently unequal or unjust. Finally, * 
the pursuit of legitimate decision-making procedures would, not 
limit the opposition to ' poJLicies. threatening % her other five values. 

* V 

-It is not surprising,, therefore, to be confronted by public , v 
policy issues where one group defends its position bj^ citing one 
of these six values, while another group occupies an opposing 
position by citing another value. For example, some groups involved 
in the elimination of segregation in the public schools operate 
on the principle of equality among individuals; Those opposing 
it do so on grounds of maintaining order, the efficient operation 
of schools, or the protection of Individual freedom. Clearly, 
these major societal values dp not provide clear guidelines that 
can be easily applied ^o resolve public policy issues . 

Rather, they as frequent ly help to increase the intensity of 
disagreement among^gr^ugs involved in those issues as they do to 
reach an acceptable, ppsitien . 

The existence of and tension among these six values are evident 
in the Declaration . A Table 1.2 lists passages representing each 
of the six public interest values discussed. - 

. All six values appear to provide general support- for the 
position of the .Ileclafation ; 31et.it is possible to envision some 
conflict among them. ' In 'fact,, the strong symbolic emphasis on - 
equality' at the /beginning of -the Declaration was not -reinforced 
by specific grievances* 'in the. remainder of " thie- document". We know 
s f rom the record of the debate over the wording of the Declaration 
that the Southern colonies blocked an attempt by the Jeffersonian ' 
camp to refer/ to slavery as an evil. Similarly, it was possible 
to excuse some of the actions of King George on the grounds of 
• the efficiency of governmental operation's. Although These 
potential Value conflicts are relatively 'obscure Th the Declaration, 
they almosyt always arise ^in discussions of public policy issues. . 
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TABLE 1.2: Values in the Declaration of Independence 



VALUES 



V ^ - 

QUOTATION .FROM DECLARATION 



1. Freiedora of the individual 
2. 4 Order within society * 



n Life, Liberty and . the ( ;pursuft of - 
t^appiness.*" .» j J\ 

"He has excitec^ domestic / 
insurrections ampngst^us. • * n v 



3. 
4. 

5, 



Equality among individuals "All mei) are created equal." ( 
Justice for . individuals 




"For <deprivjLng us in many 'cases, 
of the^Senefits of -Trial by 
Jij'ry."' , . ' , • y v 



Legitimacy bf decision- y 
making proces^ % * 



VHe- has forbidden his Governors . 
to . pass 'Laws* 6f immediate and 
pressing importance, unless 
suspended in- tlieir operation* -f 
till iras -Assent* shoy!4 be 
obt#inQ04 and when so suspended, 
* he has utterly neglected to 
V>* ttt^id to them." 



6. 'Efficiency of government "He has called together legisla- 

operations - m/ ' * _ tive bodies at places *unusua2*,« - 

uncomfortable, and distant from 

o * , <tbe depository of -public c 

^ x ~ Scords^. " 




OPTIONAL EXERCISE: The Go 



Society * Exercise 



^ x * * ° » • 

( Wtfysuggest 4 .y£tr~3ef er reading th'is section until after 

• ~< \ completing the game^yhich appear* in the Appendix. ) - * v 
'f - i ' • . «/ ' r * 

. ' - "The Good Society . .Exercise, " is designed to demonstrate ther 
role^of thesye six values in the governance of societies. Although 
the, exercises is, a highly abstracted version* of* jactual political 

* prolfesses', repeated experimental runs , of the game have demonstrated 

* the*'trade-of f s among the six values." The Society consists jof . v 
'group's with different levels of powesvas well as a powerful Central 

'^Authority (iie., government)*. The -$opr groups usually agitate *f or , 
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more power, while the' rich groups try to enlist the support of 
Central Authority in. protecting their power. Central 'Authority 
is frequently faced with a choice between supporting. 'equality (and 
therefore the demands of the poor groups fo* more power) and * 
supporting order ( and' therefore the demands V>f the ryih). Questions 
concerning the legitimacy of the decision-malfc>ng process ^and the • 
•efficiency of governmental operations, as well asf justice and free- 
dom, are raised when petitions are formed to change the structure 
bf the Good Society. 

Several general patterns have emerged from repeated use of 
this game in a variety of educational settings that correspond to 
the dynamics of tfie American Revolution. In the first place, the 
members of Central Authority almost inevitably define the "Good^ 
Socigly" as one in which their power is either- maintained ot 
increased. The other groups usually begin the exercise with an 
ambivalent altitude toward \the Central Authority. . On the one hand, 
the groups fear Central Authority because- it has so much power; 
but, on the other hand, at least some of the groups look to' • 
Central Authority for help in redressing the grievances they have 
in the so-called Good Society 

» 

In those cases where Central Authority has been receptive to 
requests for help* from the groups and attempted to appear to be . 
concerned with their interests, Central Authority has survived 
throughout the exercise with its power relatively • intact . Con- y 
versely, in those cases when the -members of Central Authority -i • 
decide "that its power is so great that it need^ not appear to be 
responsive to the other groups, the' groups usually find a way to 
unite and strip Central Authority of its powers. ' * 

'The results of t|he exercise -have obvious analogies with situa* 
tions confronting govera/neijts. National governments must be- 
responsive to those groups upon whose acceptance their authority 
depehds.l? Otherwise, these nominally authoritative actors will 
have lesgvcapacity to determine national m policies. 

It should thus be clear <that however important authoritative 
actors^ar'e in understanding policymaking, it is equally important 
to>atudy those groups upon whose support the authority for policy 
depends. , . 0 <j 



C.r Values' in the Analysis of Public Policy Issues 

• , 9 

"We. have discussed the need t'o' distinguish between values and 
facts and described the role 'of values attributable to self- 
interest and public interest concerns.* Unless one clearly comes 
to .grips with the values inherent in a public policy Issue, the 



> 14 

resulting analysis will n<J)t be very valuable. Not only muist the 
analyst understand the value basis invoked by the various actors 
with respect to a specific public policy issue, but he must also 
understand hoto his own values relate to that issue. Because our 
concern centers on analysis seeking the decision-making process, 
we need to emphasize that an important part of that analysis is the 
extent to which the analysts recognize their own value biases. 

We therefore suggest that when studying a public policy issue : 
you attempt to identify the values ope'rat ing'bn the major actors 
in the issue, and, the values whi<3*i you hold/ • 

EXERCISE 1.2:' Value* Analysis , 

A value conflict occurs when individuals or groups assign 
different priorities and assessments to conditions which affect 
them as a insult of differences in, values. Using one or more • 
public interest values, write a paragraph on a value conflict 
present in a public polidy issue. 
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III: TYPES. OF PUBLIC POLICY ANALYSIS — MONITORING, ' 
FORECASTING, EVALUATION, AND PRESCRIPTION* / 



4 , 

» 

This section introduces the basic elements of four kinds of 
public policy analysis: * 

J . 

Monitoring- (Descriptive) , that is, recording system- 
atically patterns of events and conditions over time; 

Forecasting (Predictive) , that is, projecting what 
patterns might emerge in the future; * 

Evaluating (Evaluative) , that is, assessing the degree 
to which. conditions and events have become better or 
worse according" to a given set of standards; 

Prescribing (Prescriptive) , that, is, suggesting and 
assessing alternative courses of actions that are 
designed to improve- conditions according to a given 
set of standards. 

These four activities can be -illustrated by looking at how 
investors might vi^w^the Dow Jones industrial average within 
each of the four tasks in order to make- decisions on how to 
increase their returns. Investors compute this average by 
analyzing the 30 most important industrial stocks. The "average" 
is merely>the* sum of the increases and /or decreases in the stocks 
divided by 30. This' measure is used as one indicator of the 
•industrial health of the nation. If the Dow Jones industrial 
average is continually rising,' then industry in the United States 
is growing pro^glably with a steady afeturn on investments. If the 
average shows ayg&eady decline, then we suspect that the business 
and investment e^^ate in the nation is not very good. The- A 
average is most useful to analysts when they observe its movements 
over time, as ^ for example, a 30-day period. 

The Dow Jones industrial average can serve as a tool for 
analyzing tKe policy' choices which confront - an -investor.^ First , , 
the average can be u§ed* to monitor the daily fluctuations ifl 
prices. Secondly, it&can be Used as a basis « for forecasting 
whether a set of stocks, or even one stock, will rise or fall. 
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Thirdly, the average can be used as a standard against which the 
performance of a particular stock can be evaluated^ — the degree 
it has performed for^better or worse than those -represented in*the 
average. Finally, by looking at the- performance of a set of 
stocks in relation to the average and using a forecast of the 
future performance pf the average, it is possible to decide which 
stock would be the most^'prof itable investment opportunity. 

We are not saying that the Dow Jones average is a perfect tool 
for monitoring, forecasting, evaluating, or prescribing investment 
decisions. Anyone who has invested in the stock market knows 
there are no perfect tools. : Hbwever, it does serve as a general 
procedure for organizing information to perform the kinds of 
analyses that allow one to make decisions. Although there are *o 
•guarantees, it is generally true that with respect to any decision 
the systematic performance of these four types of analysis is better 
than performing no analysis. • • 

In this ' section, we will discuss each of the four types of 
analysis, continuing to draw our illustrations from the Declaration 
of Independence* We will also discuss the data collection and . 
analysis techniques associated with each of the four types of 
analysis. 



A. , Monitoring 

The most essential .-and basic of the four analytical tasks is 
taonitoring. No intelligent discussion of any public policy issue 
can occur unleSs you are aware of th^ past and present record of^ 
*the policy environment, political actors, and public policies. 
.Although there is agreement on the importance of such'* information , 
there is less agreement on what that information is, and how. to 
obtain and present it. This section provides some guidelines on* 
collecting ,and using information to monitor public policy issues. 
• i f * * 

,We have alrpady discussed previously how the authors of /the . 
declaration of Independence^ described the policy environment, 
political actors, and public policies* relevant tQ the issue of the 
American colonies 1 decision to declare independence from England. 
All of the information cited represents monitoring of the isgue. 
The Decoration's authors introduced monitoring information with * «° 
the sentence "To prove this, let Facts be submitted to a candid 
world." In* phrasing their introduction this way, they specified k 
that their monitoring or recounting of history was performed in \ 
order to support their positipn on the issue of independence. 

Today, however, many scholars assert that the use of history 
to prove one's public policy position is a limited one. In fact, 
some scholars would say that vt # is a misuse of 'monitoring — 
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monitoring should present an objective picture pf reality. The 
'objective 1 ideal conflicts with the very nature of information 
collection and communication. Kenneth Boulding has best' presented 
this view in a book entitled The Image , arguing tjjaat an image is 
• internalized' of* subjective knowledge of one^s environment, past 
experiences, future expectations, and values. Imagery consists 
of a set of attitudes, value judgments, and behavioral assumptions.. 
It is also composed of symbols which subjectively represent reality, 
at the same time, prescribing, predicting, and commanding action. 
The image is a result of people's perceptive and evaluative capa- 
bilities and aids -individuals to^operate in their millieu. The 
most -generic of all psychological mechanisms, it provides for the 
individual a basis for action because it locates each individual in 
time and space, in a field of personal • relations , ii^ a world of 
dynamic operations, and in the midst of "subtle intimations and 
emotions." As a process, the image acts upon and, in turn, is 
acted upon by the individual. The social development of the indi- 
vidual" and the evolution of each person's view of society are not, 
two distinct processes but aspects of the same process. 

While recognizing the validity of Boulding 1 s description of 
information acquisition and collection, we also need to recognize 
the need for people to maintain what Boulding calls 'open images', 
that is, frameworks which can absorb and adapt to new information. 
This is particularly important in the dialogue over public policy* 1 
issues. It is likely that . different actors have images producing 
conflicting information, which, in turn, render impossible the«*w 
compromise and, consensus necessary for the effective operation or 
public- policy. In addition, because public policy issues involve 
intense conflict between various groups, third parties having an 
indirect interest are likely to play a large role in the final 
decision. For fetfample, the leaders of European nations played an 
influential role in the American War of Independence and therefore 
were central 'targets of the authors of the Declaration of Inde- 
pendence.. To the extent that the record is accumulated and pre- 
sented in such a way that such third parties consider it to be 
"fair" and "accurate," the monitoring is more likely to generate 
support. Furthermore; some individuals for one reason or another 
tafre no position and therefore attempt to monitor conditions as 
tairly and accurately as possible. Therefore, whether one has a 
position on an issue or is merely seeking to present information 
that will help you develop a .position, steps need to be taken in 
monitoring which make the collection arid presentation of the 
information' as systematic and objective as possible. 



Kenneth E. Boulding, The Image; Knowledge in Life and Society, 
Ann Arbor; University. of'Michigan Press, 1961, p. 5. 
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But how does one collect and present information on public 
policy issues as systematically and objectively as possible? This 
question, a continuing concern of social scientists, cannot be 
answered easily or simply. Over the years, a variety of procedures 
have been developed to increase both the systematic and the objec- 
tive basis of information. To introduce these procedures and their 
application to the analysis of public policy issues, we first need 
to have a definition . of systematic and objective. 

Systematic 'refers, to the degree to which .all relevant informa- 
tion is collected and presented. Unfortunately, it is not possible 
to do this completely- Even if we restricted the scope to informa- 
tion on just th^' policy environment, as opposed to all three . 
components — the policy environment, political actors, and public 
policies ' — there is no way that any- individual or team of 'indi- 
viduals can collect and represent information that would totally 
monitor a public policy issue. "Fortunately, there are methods of 
creating samples of information that are a valid representation 
of the whole. The most obvious example of this is the administra- 
tion of an opinion poll to a representative segment of an^ntire 
population. Other methods of examining a representative sample 
'include the application of quantitative analysis to written 
information; and the direct observation of conditions. 
* 

By objective , we mean that the information represents the 
reality it *is supposed to reflect. As previously noted, the role- 
of images and the* interpretative nature of the language of public 
policy issue discussion make it very difficult to keep researcher 
bias out of the information collection and presentation process. 

Techniques^-guarding against bias include documentation, 
Presentation of comparative information, "the detailing of facts, 
|he procedures Qf Collecting information, and the use of multiple 
sources of information. Each of these techniques allows the 
audience to render its own judgement . 

s 

These guidelines cannot ^always be followed. ^Frequently, a 
long discourse on documentary sources or the representative 
quality of a particular sample will bore dr confuse an audience, 
even If that audience consists of people vitally concerned with 
the issue. Moreover, the costs associated with complying fully 
with financial or deacULine restrictions, or both, may make it 
impossible to follow imese guidelines. Furthermore, to ,fully 
comply with them might require the use of quantitative data and 
sophisticated* data analysis techniques beyond the grasp of those 
directly responsible for the decision/ Finally, it is possible 
that ^even those techniques^ available will not work because the 
information is not ^available, in a forrn^a 11 owing for collection 
and presentation. * . 
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To illustrate, we turn again to the declaration of Independence 
which contains a long list of -grievances, representing an attempt 
to monitor the policy environment. Not surprisingly, the - list 
does not follow the systematic format outlined above. As stated, 
j^se^uideUnes cannot always be. followed. Time factors as well 

as lack of knowledge -of "sophisticated- data techniques, in^ the 

colonial period prohibited the authors of the Declaration .from 
monitoring the policy environment, using methods available- to 
today's policymakers. If the authors- were fortunate enough to have 
had the time and knowledge of today's policymakers, the Declaration • 
could have been -more effectively constructed. A listing of a 
cross-section of acts taken by England as well as a list of what 
the colonies did to provoke some of these actions would have pre- 
sented a clearer and fuller picture of that .period. 

' If the authors had been familiar with methods of data collec- • 
tion, better documentation and more specificity could have been 
included in the document. The. Declaration employs phrases such 
as "quartering of troops" and "swarms of officials."' This infor- 
mation would have been more meaningful to the readers, and possibly 
more. persuasive, if numerical information could have been 
incorporated. 

Nevertheless, the Declaration remains an instructive example, 
for reviewing the framework of public policy analysis. It is also 
an excellent reference to show how these methods have developed, 
over the years into sophisticated, systematic, and objective 
approaches to analysis. If our forefathers were aware of these 
sophisticated/ approaches, it is very likely that the Declaration 

»wbuld have included graphs of trade patterns and tax ratesT-dates 
and specif ics on the suspension of legislatures, and a survey of 
Americans to determine the degree to which they felt harassed. ' • 

-AdrSi^rted-ly-, ^-such-additions l may not compare, favorably with the 
stirring rhetoric of the Declaration. However, given the complexity 
of modern life, the nature of contemporary public policy issues , 
and the plethora of publicity, the monitoring of information 
today -needs to be consistent with the guidelines described in this 
section. 

Table 1.3 below summarizes the discussion on these guide- 
lines. , 



B. Forecasting 

' . - * 

All discissions of public policy issues concern themselves 
with the future, since expectations about conditions in the 
• policy environment stimulate political actors to debate alternative 
public policies 1 . As will be seen, forecasting methods run fhe 
gamut from the unstated "implications of monitqring statements to j 
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TABLE 1.3: Summary of Guidelines for Monitoring Public Policy 

Issues as Systematically and Objectively as Possible 



SELECTION OF INFORMATION 
COLLECTED AND PRESENTED 



EVIDENCE OF ACCURACY 
OF INFORMATION 



1. Provide a basis fox conspariscm 
over time or across similar 
conditions. 



provide ^documentation 
of information. 



2. Draw a sample of information 
that represents the subject 
♦in an unbiased way. 

-3,. Use surveys .where applicable. 

4. tlse as much quantitative 
information as possible . 



Use multiple sources 
of information. * 



Provide detailed information. 

Describe methods of collect- 
ing irif qrmation'. 



elaborate computer models. Again, the forecasting may be done 
with respect to ail three categories in the .basic public policy 
framework (actors, policies, environment), although the primary 
focus of attention, as in the case of monitoring, • is on the 
evolution of conditions in the policy environment. 

• * * 

This is typical of most of. the forecasting that appears in 
the informal analysis of public policy issues. The Declaration,- 

for example, states that M the history of the present_Kin£_of__ 

Great Britain JLs a history of repeated injuries and usurpations, 11 
and then makes" the k.ey prediction of the document: u all having in^ 
direct objective the establishment of aji absolute Tyranny over 
these states. 11 T^he forecast is typical because it uses two common 
bases fp£ such predictions. The first is simple extfrapQl-atiojj from 
the past into the future. Thfe authors present the record of events 
and cdnditions of the past as evidence of the existence 6f an 
absolute tyranny. It is assumed that matters will continue to 
deteriorate. The second is the attribution of motivation to^the 
King. It is arguecf^fcfeat the evidence indicates that *the King 
"evinces a designs to reduce them 'under absolute Despotism" which 
can be used to forecast his future tyrannical behavioxl . * 
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_The use of trend projection is a widely u£ed but crude basis 
for forecast ing.^ 7 ~Trend projection is based on the* assumption that 
what has b*en happening will ' continue to happen, frequently with 
indrealed Ineed. It is crude because it fails to recognize ."break 



increased speed, jt is crude because it fails to recognl 
points 11 or critical thresholds wljich might result in changes of a \ 
trend,, although it is frequently the only basis "for making a - -\ 
forecast — .particularly when the conditions are unique — as in 
**the case of the Revolution..; -* ■" . . 

Motivational analysis is' used in public policy issue research' 
when there are a few key actors whose values and images appear td 
be able to shape conditions. It is more frequently employed in 
the prediction of the behavior Of* political actors and ^he evolu- 
tion ISfr public policies than in the forecast of conditions in the 
political environment.- Its main limitation is 1 that it is virtually 
impossible to be sure of the motivations of most human beings, 
particularly those in powerful political positions. Usually, * 
multiple goa/Ls and a variety of other actors influence the key 
pplitical actors, meaning that\the basis for such actors 1 behavior 
could alter radically. 

We are not saying, however ,\that trend projectiQns, or motiva- 
tional analysis ^should be avoidedVn forecasting public policy 
issues. Our point is thafr such approaches to~ forecasting are based 
on a variety erf untestable assumptions. To the degree that you 
have access to the information necessary for testing su&Jj assump- 
tions, the confidence in the. forecast increases. We will now > 
briefly examine' forms of forecasting that make 4 the •assumptidrrs 
underlying the forecasts more explicit, and testable than the kinds 
of* informal and implicit predictions* appearing in the Declaration. 

1. Explicit Verbal Forecasts 

... j 

By listing grievances .the Declaration \attempts to establish 
the basis for its forecast .T^ If the monitoring statements could m 
have conformed more closely to the contemporary techniques outlined 
previously, 'the verbal forecasts' themselves could have carried more 
weight. In addition, if the colonists ' had access to i thg^appropri- 
ate data, they' could t have indeed more effectively criticized the 
King's? actions. Their arguments could have been more convincing' 
if tfiey .presented an analysis of Influences on the King as well as 
the past record of the King in other situations. 

The k^y to improving verbal forecasts is. the clear statement > 
in propositionaJUterms, of the assumptions underlying the fore- 



cast. A proposWion is a statement^ of the .relationship between two 
or more* variables that can be examined further. -,»The propositional . 
format for the major prediction in the Declaration might have been 
"within a given society,, the occurrence of despotic behavior at one 
time period leads Jo an increase of such behaviorwin subsequent 
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time pehfcods." Stated in this way, it is clea* that both assump- 
tions are open to sefious questioning. Even so, it would improve 
the forecasting hetsis of the document as, it wouldvi^Low readers to 
relate similar xfircunjstances to test *the proposit iontan t'heir*own\ 

An additional method of making explicit the basis of verbal 
forecasts is the use of a scenario . A scenario is a statement of 
the likely evolution of a set of interrelated -events and conditions. 
The authors of the Declaration 'could "have-used a scenario to 
delineate how they thought present condition^ would lead to an 
absolute dictatorship. The value of suska method is*that' it 
clarifies the assumptions underlying a forecast anc| allows the 
audience t.o examine in specific detail the logical relationship* 
between events and conditions. An additional value of the scenario 
is that it forces the/analyst to imagine- alternative courses of 
events, sometimes introducing new assumptions that might have been 
ignored. * 

An even more powerful method of introducing new assumptions 
is the use of role-playing or^ gaming techniques / The Good Society 
Exercise, presented in the Appendix, exemplified, ajpole-play ing 
exercise which explores methods df establishing 4 e cision-maklng 
structures. Such structures are designed to. achieve particular 
values. Exercises ^similar to the Good Society Exercise, but placing 
greater • emphasis on specific public policy content; cap be used to 
identify assumptions underlying public policy if (Recasts. Although 
the construction of the exercise and -the participation by a -number 
of individuals entails a substantial ^investment of time and effSrt, 
it can help to genarate a wide variety of forecasts that tf&n be „ 
examined through other techniques. 

Scenarios and role-playing exerQises caa help to increase the 
variety of forecasts as well as the range 'of assjumpt ions under- 
lying such forecasts. They can be used to supplement interpret a- „ 
ti&ns obtained by monitoring the conditions ^sifrrounjdiri'g a public : 
policy issue. Although they do not necessarily lead to improving 
the explicit nature of verbal forecasts, the*' tasks of ^scenario „ 
writing or role playing can generate 4:he basis fpr more system-* , 
atically exploring assumptions. , . i - 

*** * ' 

2. ^Formalizing Forecasts * / > , 

The necessity for stating forecasts in „pr6posit ional terms 
has already been discussed. There axe three reasdns for this nefed. 
First, proposit ional analysis increases the. awareness' of bo£h the 
writer and' the audience 9f the intellectual basis for the forecast. 
Secondly, using the method makes it easier to test the. forecast 
with information from relevant examples.- Finally, it 'provides a 
basis for assessing the validity of t4ie forecast as events and 
conditions unfold. For these reasons*, it is important to £tate 
forecasts in propositional terms. € . ;." 
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Once so. stated, it is easier to generate and • evaluate # 
predictions using a number of* pew techniques.- Wfc will briefly 
disp<tss.two classes of such techniques -7 statistical methods and 
cdmputer simulation. - 

a) - Statistical Techniques #> * . 

Of all the formal forecasting methods, statistical techniques 
are the most widely used. Although we cannot provide an exhaustive 
discussion of such techniques here, we 'can , illustrate their use in 
generating; and evaluating forecasts. Statistical techniques,- 
including the use of graphs arid charts, a.re methods -for organizing 
quantitative data for the purpose of exploring propositional 'state- 
ments. 

The time-series graph , similar to, the one pictured below, is 
a well-accepted representation of trend prqjection. Figure 1.2 
applies a time-series graph to information posited in the 
Declaration. 
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Figure 1.2: 
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Sourcs: Oliver H. Oickerson, The Navigation Acts and the 

4L American . Revolution . Philadelphia: University of' 

Pennsylvania, 1951. _ 
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The graph portrays the relationship between the colonies 1 
imports to England and England 1 s, exports to. America. By* extending 
the graph int^> the future (represented by the dotted lines), the 
forecast is made more explicit. The writers of the Declaration 
could have used such a graph to strengthen their arguments regarding 
dominance by England. As the colonies attempted to become self- 
sufficient by making their own products, and so forth, England 
forced the colonies to purchase her goods. And when the colonies 1 
imports to Britain slightly increased, these forced exports on the 
colonies increased tremendously. • V 

One can also derive a. statistical measure stating this rela- 
tionship between imports and exports.' This measure is called 
Pearson's product-moment correlation (usually symbolized with the 
letter "r") arid is expressed with a number ranging from -1.0. to 
+1.0. To the extend 'that r approaches +1.0, the export and import 
rate will rise at the same time. To the extent that Jit approaches - 4 
-1.0, the forced exports are decreasing while imports increase. 
The particular correlation for Figure 1.2 is +0.94, indicating, as 
the Declaration suggested, that exports were tied to imports. 

Many statistical techniques can be Utilized in public policy 
analysis. >, Forecasts can be interpreted through analysis of 
various visual display techniques and through statistical measures. 
Central tendencies ^ofSlnformat ion can be summarized by employing 
means and medians'. Bay Graphs are useful for comparing conditions 
in different areas. There also exists many measures of association 
that are useful for determining the relationship between two or 
more variables . These so-called multivariate techniques are > 
frequently employed by policymakers. 

Statistical techniques can also be used to test propositions 
that posit relationships between two or more conditions. For . 
example, one" of the grievances cited in the Declaration is % the_ 
King's refusal to re-establish Houses of Representatives in the . 
states after their dissolution. The authors referred *to "...all 
the dangers from without, and convulsions within." This can be 
stated in propositional terms as the longer a° colony exists with- 
out an elected legislature, the more likelv the occurrence of 
internal convulsion. We can analyze such /a proposition by employ- 
ing what 'is known as a contingency table . ^ 

In an actual study, the number of colonies corresponding to. 
the four possibilities would have been entered in the four cells 
of the table (where the letters "a," M b," "c," and "d" are 
entered in, the sample table below). Such a study would reveal 
that most colonies without a legislature had a laifge amount of* 
internal convulsion. Therefore, box M c" would have a* relatively 
large number . After entering numbers in all the cells of the 
contingency, table, it impossible to calculate a measure of 
association for the- joint occurrences. This is done by, employing 
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TABLE 1.4: Contingency Table 4 



Number of Colonies With: 



High Amounts 
of Conyuleion 



Lou Amounts N 
of Convulsion 



Number of 
Colonies: 



.With a 
egislature 



without a 
legislature 



a 


b 


< 

c 


d. 



. • * y . - . 

a statistic known as Yule's Q. The statistic^, like the correla- 
tion statistic "r, M discussed abo/e~, can range fx6m -1.0 to +1.0. 
A value of -1.0 means perfect negative correlation, +1.0. means 
perfect positive correlation, and 0.6 means no -correlation. 

b) 'Computer Simulation Ifodel 

- ; 

^ In recent „year§, a special technique for handling predictions 
involving a number of variables with complex relationships has 
emerged. Kn6wn ts computer simulation model*, this technique 
employs use of a systematized set of relationships fo calculate the 
relationships among factors in order to generate a forecast. While 
the mastery of the total technique requires substantial expertise, 
it is possible to Isho^the basic characteristics of the approach, 
in a few pages. 

/ The most critjfcal first step in devising a simulation model 
is to produce a pictorial representation of the relationship among 
the factors, or, as we shaW. call them, variables. Such a pictorial 
representation is frequently referred to as a causal loop diagram . 

'\ 

The Declaration of Independence contained many forecasts of 
how the .social ana economic environment in the ,New World would 
evolve if present trends and condition* continued. Many* of these 
environmental conditions had a mutual feedback effect on one 
another. That is, the more that one condition increased (or 
decreased) the more that another condition increased (or decreased) , 
because of their mutual^ef f ects qp each bther. .An example of this 
is the relationship mentioned in^he Declaration between two * 
. conditions: *** . 
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x ^Arbitrary political control exercised by the King r over 

the colonies,- and . - ■ ^ * , 

(2) Restriction of ^population growth in the colonies. 

On one ha^d, the writers explicitly asserted that^the more^ 
arbitrary political control was e*ercis-ed, the morev there was 
restriction on population growth. , On the other hancf> what they 
implied w^s that th^ more population growth was restricted, the 
more arbitrfc^y political control could^he easily exercised over the 
smaller population. This is what social 'scientists call a positive , 
feedback loop and is -symbolized in the following figure: 



Figure 1.3: Positive Feedback Loop Diagram of tlte^ . 

Relationship between Arbitrary Political 
^ Control and Population Growth in -the 
American Colonies 




Or. 




ARBITRARY. POLITICAL RESTRICTIONS ON 

CONTROL ^ ^\ . POPULATION GROWTH 



_ ...x_- 

(The $ in the ^middle of the tt|t> factors, either increase 
~" or decrease at the same time*) 



, < The forecast produced by this line of reasoning whether 
presented verbally as in 'the -Declaration , or jsymkolically , a§ v 
above is thatj9o;tJi authoritarian political control and popula^ 
tipn growth restrictions would continue*. to grow indefinitely 
into the future unless something interfered to change the relation- 
ship.- It was just such kn "interf erence" that was representexi/by 
the call for independence and 'revolution issued by the American K 
leaders. - The same- forecast -was made here through jooth verbal- and 
symbolic presentations of a simple aspect of the social environment 
in, the colonies. There is, however, a special advantage in using • 
the symbolic £orm when dealing with many different elements in a 
complex^envi^onmeht • In recent ydarS, social scientists have, 
developed techniques 'to enter such mpdels of relationships int$ a 
computer to simulate the^dynamics of even very complex environments 
thereby producing forecasts for policy analysis. 
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In the foregoing, we have survey a variety of techniques and 
guidelines relevant to "the forecasting of conditions and events ' 
associated with public policy issues. Th$ available techniques 
range from very informal statements to statistical -analysis and 
computer-based simulation. However, as in the case of monitopipg, 
it is not always possible to use more systematic techniqjiQS. gWen 
^he nature of the audience or the amount of time and money avail- 
able.- At the y6ry least, however, the intellectual basis for 
forecasts should be articulated as clearly as possible. 

tf s Table 1.5 below summarizes the points in this section. 

i ' ' - • . 

TABLE 1.5: Summary of Guidelines for Forecasting 



1. Clearly identify what you are forecasting and the time frame. 

2. Present factual information in making forecast . 

3. - State the underlying assumptions used to get from the present 

to the future. 

4. 'Use quantitative data, statistical analysis, graphic displays, 

role playing, and computer simulatioh to explore different 
underlying assumptions. 

* * 

C. Evaluation 

~ : • • ' V 

Just as concern for the future underscores the^ growth of publip 
policy issues, disagreement over the worth of existing public 
policies plays a major role in tjie growth and rnitcome of public 
policy issues. As a result of this, the analysis of public policy 
issues must measure* existing and future conditions against the 
values of those most affected by the policies. The value types^ 
affected by public policiy issues, and demonstrating how the 
Declaration of Independence augmented both self-interest and 
public interest values in the. analysis of the independence issues, 
were discussed earlier in this chapter. * 

> This section will describe procedures for the systematic 
application of values to public policy* issues: The informal method 
of application exercised in the Declaration was a listing of 
grievances in the form of specific criticisms of King George's 
actiops. --The evidence presented clearly demonstrated that 

v •• • . v .- , . 
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self-interest Values*, such as economic benefit and the public 
interest values of order and legitimate .governmental decision 
making, were threatened, However, the inference as to which 
values were threatened was left up to the reader, and the'-failure 
to apply other values such as equality, lacked the systematic 
approach that is important in the evaluation t>f contemporary 
public policy issues. 

• 

Two basic steps are -required to^g^stematically evaluate a 
public policy issue. The first stepjLs to determine which values 
are to be used in the evaluatipn. The, second step is to collect 
information useful in determirig, the degree to which those values 
are realized. Generally, policy evaluation >±s focused on the 
degree to whiqh a given public policy contributes to conditions 
conforming to Specific values in the policy environment. Occa-. 
sionally^ evaluations focus on the legitimacy of the decision* 
making processes; leading to a specific public policy and its 
implementation^ 1 * In the following, we will discuss the two basic 
steps with .respect to both questions. 



1. Identifying Values 

How a variety of values surround most public policy issues, 
and how ambiguously stated such values are, has beep previously 
discussed. The multiple and ambiguous nature of .this va}.ue 
dimension makes it difficult and sometimes impossible 'to conduct 
.systematic evaluation. However, this is a reality of public 
policy issue analysis that mustf be recognized and dealt with as 
effectively as possible. The first and most critical step v ifeito 
identify each of the values involved, and, if pqssible, • tyf IffcCt 
them in order' of importance • • • 
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We have already cited both'self-interest and ptxklic interest 
values tfrat underlie the -Declaration of Independence, and noted 
how ambiguity and conflict could have been avoided. . However, it 
is- possible to clarify an order for the values. Table 1.6 lists 
the values in* order of 'importance, why we think they follow that 
order, and a specific definition of the terms. No doubt, 
historians of that period might* find themselves disagreeing with 
these interpretations. " It is possible, however, to formalize 
thayalue dimensions by examining the* degree to which the document 
maKes specific reference^ to the values concerned. The, table pro- 
vides, as evidence for the priorities, a rough count of the themes 
in the 27 grievances listed in the Declaration . 

Table 1. ^establishes both priori-ties and a clear definition 
pf th k e^ values applied „ to the issue of independence. In reading 
through the table/ it should be obvious that both" the definitions " 
and the priority estimates would not produce unanimous agreement 
among, tfie signers of the Declaration. The 'la$k of agreement is ' 

i 
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TABLE 1.6: Identification and Ranking of Values in Declaration 



VALUES 



DEFINITION 



EVIDENCE FOR 
PRIORITIES 



1 4 Logi&aocy of 
dscislon asking. 



2. Qrdsr within 
socisty. 



3. Economic 
intsrssts. 



i 4. Rustics for 
individusls. 



5. Frssdoa for 
individusls. 



6. Effioitncy of 
govornasntsl 
opsrsti'ons. 



7. Equslity- 



Custoasry snd legal 
procedures for Making 
end edninietering 
lews* 



Action to ainiaizs 
chencee of violence 
fro* both within end 
without. 



Action to increeee 
opportunities for 
economic growth or 
decrees* economic, 
loss. 

The neintsnence* of 
rules for fair trsat- 
aont of individuals 
by ths governaent. 



The.aeintononco of 
rules end conditions 
so thst individuals 
can axorciss*basics 
of fros spssch and 
activity. 



Adainistrstivs 
structures thst csn 
sfficisntly dssl with 
sociotsl conditions. 



Rules sn^ conditions 
that sllow ssch 
individual the sans 
opportunitiss ss * 
svsfy othsr individusl. 



37JC (10 of 27) 
of ths grievsncss 
refer to-failure 
» t? allow norael 
decision-waking 
processss to 
opsrs£e. 

33JC '(9 of 27) 
of the grievsncss 
refer to violent 
sets or. prbaoting 
conditions for 
violence. 

1556 <4 of 2?) 
of the grievences 
list sctions 
affecting economic 
conditione. 

15J« (4 of 27) 
of the grievences 
cleerly identify 
infringoaonts on 
ths operetion of* 
the law with re- 
epsct to the in* 
dividuel. Saverel 
other grievances 
indirectly Men- 
tion this concern. 

Mentioned indi- 
rsctly in ovsr 
half of the 
grievences decid- 
ing with Justice 
. end legitiaecy 
of decision 
asking. 

. ' • < & 

Mentioned di- 
rectly in one 
of the griev- 
ences and im- 
plicit in aany 
of thoee deel- 
ings with ths 
dissolution of 
legislature. 

Not directly 

mentioned in 

the grievances 
^Jaut sppssrs in 

the opening 
• rhetoric. 
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a natural condition for most public policy issues, given the verjfr 
nature of public policy issues and the number of actors representing 
different value perspectives. Both the definitions and the ranking 
of values are difficu^ to establish. This is true even Vhen there 
is general agreement on the issue, as there was in the case of the 
Declaration. Nevertheless, in order to perform systematic evalua- 
tion, such agreement must be assumed. 



Therefore, tq completg^the first step in systematic evalua- ( 
tion, it is necess„ary to clearly define and establish priorities 
for the major, value concerns. " Such a listing is assumed to'be 
correct for purposes of the evaluation /"^although disagreement may 
be present. * I „ / * 

2i Measuring the Values 

i 

^Assuming* ypu have defined and ordered values, the next step is 
to evaluate the degree to whioh the values are maximized by condi- 
tions emanating .from the public , policy., or by the processes through 
which the public policy is formulated and implemented. The tajsk is 
difficult because it involves 'determining empirical or real-world 
indicators for "gach of the values, and then collecting samples of 
data for those indicators that allow judgements to be made. 

* The determirf&tion of empirical indicators is called operation- 
al izat ion fry social scientists'.. In the Declaration , the authors 1 
grievances could be considered rough operat ionalizations^of the 
values, since they were attempts to provide empirical .information 
on the degree to which certain - values were achieved .or threatened. 
However, today's social scientists would not consider them to be 
fully adequate operationalizatiorife because the ^values were not 
clearly defined and related to empirical coficfcLtions. 



Ci*ucial to good operatiorialization is the maxim that two or - 
more different ^people could take the definition and rules f or x 
collecting the information and apply them to ttfe real world with 
the same' results. The Declaration does not contain the rules for 
operationalization, so it .is very possible that a different set, of 
authors or even the- same authors, a month later, would devise 'a 
different list of grievances. 'Systematic evaluation requires that 
data Be collected according to specific rules guarding against' 
bias, askdiscussed under monitoring. 
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For example?, you could ^opetrat ionalize the value of legitimacy 
of the decision-making processes, by saying that the, average length 
and frequency of one colony f s legislative meetings during the 
1760s, represent a standard against which the j length and fre-*„ 
• quency of the same meetings during the 1770s can be measured. 
Once the norms are establ ishedy^and the procedures foi* measuring 
the length and frequency delineated, you could measure the degree 
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to which the norm was violated in the 1770s, This could be estab- 
lished for each colony, and would provide a picture of that 
particular aspect of legitimate decision-making process that wotfld 
be the same, regardless of who collected. the data, * 

However, even if such rules are developed and followed, the 
systematic evaluation of public policy issues requires that condi- 
tions be monitored to generate information allowing for comparison. 
The 'example above does allow for such a comparison because it 
creates the opportunity to measure a more stable period — $he 
1760s — t with a period when it was asserted that illegitimate 
decision-mgtking processes were fostered by the King, 

There ar$ 'two basuc methods of generating comparative informa- 
tion. One method frequently used' in public policy issue analysis • 

fls the monitoring of conditions over a period of time, referred to 
as longitudinal analysis ,- This method f s ability to trace a condi- 
tion in the policy environment prior to, and after the initiation 
of a policy, accounts for its frequent use. The second method, - 
cross^sectional analysis , entails the collection of information 
used to compare unitfe experiencing similar conditions. For- example, 
the British decisions regarding the American colonies during the 

'decades 1760-1780. could be compared- with treatment of othef British 
colonies during /that same time period. This would help to 'ascertain 
the degree of difference in the decision-making processes. 

Table 1,7 summarizes the guidelines for evaluation presented, 

. \ 

TABLE 1,7: feummary of Guidelines for Evaluating 
Public Policy Issues 

* 

1, Clearly define relevant values — self-interest and public 
i interest, 

2, Establish priorities among values so that the most important 
can be evaluated,, . * 

3, Develop rules for collecting information relevant to those 
values (operationalizat* ion) , 

4, Collect "data that allow for comparisons over time or across 
similar situations or both* * 
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D. Prescription ; , ( 

* Prescription is the suggestion and assessment of alternative 
public policies, and builds on the three forms of analysis already 
discussed. It requires that existing conditions be monitored and 
evaluated and that future conditions be predicted. Because it 
, incorporates all three forms of analysis, prescription is the most 
complicated of' the four types of analysis. ' 

The difficulties inherent in. the, task of prescription are 
.illustrated by the Declaration of Independence. That document 
announces the establishment of a free and independent United States 
of America as the prescription tor all of the colonies* ills dis-„ 
cussed in the document's body. It is clear from the wording of the 
document that though the authors felt the establishment was the 
only logical course of action, they were also aware that the course 
was both unpredictable and dangerous. Lack of certainty about out-' 
come and the ratio of benefits to costs led the authors to end the 
Declaration in a manner that can only be interpreted as anxious 
desperation.. This is illustrated by the statement, "And for the 
support of this Declaration, with a firm reliance on the protection 
5 of Divine Providence, we mutually pledge to each other our Lives, 
our Fortunes and our sacred Honour." 

While t most public policy isjsueg do not raise such massive un- 
certainties and monumental costs as did the Declaration of 
Independence, they all confront political actors with uncertainties 
regarding costs and benefits. Fgg that reason, it is necessary^ when 
approaching a prescription to provide information on the relative 
•benefits and costs of alternative solutions to the public policy 
issues. To obtain such information, -one -must build on monitoring, 
forecasting, and evaluating. _ 

If you employ systematic monitoring information, it is possible, 
to form a base line against whiqh policy can be forecasted and 
evaluated, the evaluation of an existing public policy issue can 
indicate the degree to wtiich the important values were maximized 
under the present policy. A forecast assuming the continuation of 
the same policy could indicate the likely benefits and* costs, given 
those yalues in future perspective. * Against these projections, one- 
can estimate the degree to which alternatives would be "better" or 
"worse" than the continuation of the correct policy^ # 

A policymaker constructing the Declaration today would ,possibly 
have collected data on trade patterns involving the colonies, apd 
then projected the likely future patterns of the colonies if they 
continued under the existing regime.- Then, alternative arrangements 
could have been identif ie#. Ea,ch of the alternatives could have 
been analyzed with forecasts made of the determined consequences. 

Finally, a .comparison could have been made between the consequences, 

' * * * 
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of alternative policies and the continued control by Great Britain, 
A graph similar to Figure 1.4 could be developed which provided 
alternative projections. We use alternative dotted lines to 
represent 'different projections. This type of graph represents 
the previously -discussed systematic prescriptive analysis. ^ 



Figure 1.4: Alternative Projections Qf 
Total Imports and Exports 



Total 
5, 000,000 
4,000,000 
3,000,000 
2,000,000 
1,000,000 




1769 



1770 



1771 



Years 



Soiitce: Oliver Dickerson, The naviga tion Acts and 
the American Revolution Philadelphia: 
University of Pennsylvania, 1951 « 



While it is important to attempt to develop a systematic ba>sis 
for such prescriptions, as illustrated by our .example, it is also 
important to attempt to^ measure both the intended and .unintended . 
consgqtiences of a given public policy alternative. It is rtrue that 
one bourse of action might raise trade fbr the colonies, but what 
additional costs and benefits would result? Frequently, those 
costs and* benefits cannot be easily measured in quantitative tertas. 
There, are a variety of methods for estimating costs *apcL benefits 
and in fact theref is an entire set of procedures frequently called 
cost-benefit analysis : However, it is sometimes impossible toy 
estimate such costs or benefits, 1 

For example, how do you estimate the amount of life and prop-, 
erty destroyed by the War of Independence? Was the establishment 
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of the United States more costly than the continuation of British 
rule would have been? How do you take into account the effect of 
time op the policy alternative? The generation v Jiving at the time"' 
of* the War for Independence suffered more of the costs than the * 
next generation, while the latter no doubt enjoyed more of the 
benefits'. In such' areas as security from invasions by foreign 
powers* or limitations 'on the flow of people between Britain and 0 
the United -States , it is possible that independence was more costly 
for individuals in the colonies. . 

As stated earlier, these areas of assessment are more 
complicated than some of the public policy issues "that confront us 
today. However, these kinds of 'considerations are of extreme* 
importance. For this reason, it is essential not only to develop 
a systematic information base for weighing policy alternatives but 
also to consider as many intended and unintended consequences as 
possible. 

Table 1.8 summarizes "the steps /to be taken in developing 
systematic prescriptive analysis. 



TABCE 1.8 Summary ©f Guidelines for 

Prescribing Public Policies 



1. Conduct a systematic monitoring* forecasting, and 
evaluation of existing public policy. 

• * • / 

2. Identify alternatives a l nd project their consequences. 

« 3. List all possible intended and unintended consequences* 

* 4. Weigh ,the benefits arid costs bf the consequences of 
each of the alternatives including the continuation 
of the existing policy, as much as possible. 
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EXERCISE 1.3: Applying the Four Types of Analysis 

Select ah editorial that takes a position on "a public policy 
issue. ' Identify one, of each of the four types of analysis 
expressed in the. editorial either by. quoting directly from the 
editorial or paraphrasing what was said. After you have listed 
each of the four statements, write a brief essay assessing the 
analysis presented in the editorial using the criteria provided 
in- this chapter. 



J 
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APPENDIX I: RuYes for the Good Society Exercise 



You are about [to participate in a society cor^sisting of s^ven 
teams. Six of thelteams consist of two to five players each 
are called Groups (A, B, C, D, E The other team consists 

four to six players and is called the" Central Authority, The' 
Groups and the Central Authority behave in the Good Society accord- 
ing to *the following statement of principle: ^ 

' - * -S ' " 

- r 



This society guarantees equal opportunity and equal 
rights to every member. It advocates the need for 
stability, change, and justice; ^Inequality is as 
enslaving as disorder. Order ancl justice must 
prevail. * \ 



* 



Despi-te this statement of^principle , the "goods' 1 of the Good 
Society, as measured by |rower/Units^ are not distributed Equally. 
Moredver^ -the 'ability tqjf make changes, in the Good Society are not * 
shared eqUally by %he gmups. The simulation exercise is designed 
.to refcres^ht fl^iat happeifk in a\saciety in which ofder and justice 
are it£* ^licteTii^es , yet| th$,reaiyfy of; the society runs counter to 

Changes in the 'Golj^ffd&iety g 0 , . % \ * * 

sigtits ( t^/junits u iise^cS^eo ^measure i*h< 
each team 'i^^thp^sg'cxefly ) arid' petit: 



Power Weights ( t^/iunits^iise^Sito ^measure i*he wealth an$ . 
influence of each team 'i^^thp^sg'cxe'Qy ) arid' petition Weights (the 
weight of each team in the*^signilig of; ? a Petition) are "distributed 

- *- ' — ........ 



— w — - — >- r — <p — a * ( 

in the following manner airtbng tl^^bjfefr ,Jj^am£ df the Good ^Society . 



Name of -Team 
* 


Power wW 




Petition 'Weights 


Central Authority 
Group A 
Group B 


^ 100 

45 
35 


o 

4 ft 
$ 




3 \ • 

. ' \ 

2 , \ 


Group C v * 


10 




A 


1 L* 


Group D 


8 


t % 
•t 




.1 • . « \ 


Group E «C? 


^ "* 4 


f 




o 1 

1 

* 


^XGxoup F 


4 






b _i 


Total- 


206 






11 , 



.50 
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Changes in the distribution of power units as well- as any ^ 
other facet of life in the Good- Society can occur in two #ays: 

. A Petition can be signed by the teams representing 
at least six Petition Weights which call for any 
specific change. 

. A War can be fought -between any team in the society 
I in 'which the more powerful size (the larger number 

\ of Power Weights) gets all but one of the losing 

side's Power Weights. • 

' In any redistribution of power point, no fractions may be 
used. Power points may be neither created or destroyed. 

'.7; 

Maintaining Order in the Good Society . 

# 

• The maintenance of order in the Good Society is the responsi- 
bility of all of the members, although given the large number of 
Power Units at its disposal, the Central Authority has a special 
role. It. can engage in War against members^that fail to live up to 
the principles of the society and can attempt to get Petitions 
•signed. At the same time, it is up to the six groups to make sure 
that the Central Authority does not abuse its role. These groups 
can sign Petitions to -limit the actions "of the Central Authority, 
even to the point of redistributing the power. (It is important 
to'note that in any redistribution of power units, fractions' cannot 
be used and power units cannot be destroyed or created.) 

1-. All decisions taken by the Groups must be unanimous.: All' 
decisions taken by Central Authority mus^ be supported by 
a majority of all its members. ' > ■ • 

■ '« -' fe 

2. A Petition Form will be used for purposes of peaceful . change. ^ 
Any Group or the Central Authority* can initiate a Petition. , 
Once enough signatures of teams' to- constitute six Petition ..' 
Weights has been -achieved, the Petition , should- be submitted 

to Simulation Control. It goes into effect as soon as Central 
officially announces the Petition . It remains in effect until* 
a different Petition is completed to alter the original one. 
No Petition can go into effect between the first declaration 
of War and the end of the War ten minutes later. . • / 

3. War occurs when one or more teams declares War against one' . 
or more other teams. A War Form is submitted to the Simula- 
tion Control, who will inform the other teams. The attacked 
team will have five' minutes to counterattack. More than one 
team can attack and more than one can) counterattack. The side 
with the largest number 'of Power Units will win the War and 
will get all but one of the other team's Power Units. If more 
than two teams attack and win, the power units won will be 
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distributed in accordance with the relative Power Units * 
of the winning team. Any teams submitting a War Form may , 
1 retract it <before the fi%e-minute time limit is up. 

* Familiarize yourself witti/the two types of forms which you will 
use, in the game: Petit4on Foms and War Forms . Copies of each 
form will be available from Simulation Control. 
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CIRCLE THE INITIATOR: 



'OUTCOME CALLED FOR: 



PETITION FORM 

Central Authority A B C 0 ,E F 
(Circle One) 



TEAM 

Central ' Authority 

Grdup. A 

Group B 

Grjoup C 

Group D 

Group E 

Group F 



PETITION 
WEIGHTS 




1 
1 
1 



(In order for the outcome to become a part of the Good Society, 
enough teams representing at least six Petition Weights must 
agree to the Petition. A majority of members of Central Auth- 
ority must sign for its Petition Weights to county All members 
of any group must sign for its Petition, Weights /to count.) 



WAR FORf 

CIRCLE ATTACKER(S) : CENTRAL AU^HOfllTY A B jf* 0 E, F . 



ircle One or Wore) 



CIRCLE TARGET(S): CENTRA^ AUTHORITY A B C D E F 

(CirctLe One or More) 



>3* 



SIGNATURES OF EACH MEMBER OF ATTACKING TEAM 
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CHAPTER TWO; LIBRARY RESEARCH FQR THE 'ANALYSIS OF PUBLIC POLICY 

« 



THE PRIMARY OBJECTIVE:. • - •» i 

To assist you in identifying and locating information 
V. available in libraries on specific public roI icy issues. 



UPON COMPLETION OF THIS CHAPTER, YOU WILL £E ABLE TO: 

* Locate definitions for any terms related to a particular 
policy is^ue.^ 

* Identify apd locate descriptive information on events and 
conditions relevant to a public policy issue. 

♦Iden^i^y and TocUte" appropriate books, articled; govern- 
mental arid nongovernmental, iij^ormat ion for your public 
e policy issue. ) 



* Access information stored on microform as appropriate to 
yoiir research. 



ad? 1 '"* ^ * J * 



tlygjs--<>f 



(Based. on PS-19: Library Research ; for the Analys*s-<>f Public Policy , 

Renee^S. Captor, Croton-on-Hudson, NY: Policy Studies Associates, 

1979.) * -v„ 

r * • 



I : JNTRODUCTION 



This qhapter can be used in two ways: % it can serve as a 
step~by-step guide- in doing in-depth research on a specific topic, 
or as a general introduction to library research. The exercises 
in each sect ion w ill give a be tter understanding of the -w ay to use 
each type of information source, , and are designed as~ an integral \ 
part Of the learning process. * t 

' ' This chapter should improve your skills in -researching topics, 
whicfcf are public policy issues — defined as those which concern 
governmental action on matters involving societal conditions, and 
ovei^wliich people disagree. Before beginning, a public policy 
/fssue should be chosen. If you have a public policy- issue in mind, 
then you are ready to begin working; if not, you might try one of 
the following: 

1.' CETA ajid other manpow§r policies. 

• 2. A proposed constitutional amendment. 

3. Urban Renewal. 

4. M^kLc'aid. 

5. - Contr^fo^siaL changes in the Juvenile Justice System. 



EXERCISE 2.1: # Choosing a Topic 
♦ 

My Proposed Topic Is ; 
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IU DEFINITIONS — DICTIONARIES AND ENCYCLOPEDIAS v 

(' 

- «m 

* The first step in research is to clearly define what you are 
studying. Often, a close, look at the definition of your topic 
will give a -better idea of what types of facts are called for and 
where these facts might/be found. 

Occasionally, you might run across specialized terms, or 
"jargon." A dictionary or encyclopedia will supply a definition 
that could clarify these specialized terms, allowing a better 
understanding of technical writings. 



DICTIONARIES 

Dictionaries primarily give short definitions, proper spelling 
pronunciation, and syllabification. Some dictionaries also pro- 
vide* information on the origin of the word. The following are^ 
some good, all-purpose dictionaries: 

Morris, William ed. , American Heritage Dictionary of 
the English Language , New York:^ American Heritage 
Publishing Co., 1969. ' . 

Murray, James A.H. et al., eds. , The ^Oxford English 
Dictionary , Oxford: Clarendon' Press , 1933 (with 
supplements). 

Neilson, Allan, ed. , l Websteri-s New International 
* v Dictionary of the English Language , Springfield: 
G. & C. Merriam Co.,- 1961. 

Stein, Jess, ed. , The Random House Dictionary of the_ 
. English Language; , New York:^ Random House, 1966. 

If you are looking Sbr a specialized term, a more .specialized 
dictionary might be necessary. You might try one of the following: 

\ ^ 

Gamboa, Melcjuiadea, Dictionary of International Law and 

- Diplomacy , Dobb's- Ferry, NY: Oceana vPublicat ions, 
1974. , ^ , 



Hold, Sol, ed., Dictionary of American Government , 
. New York: Manor Books, 1970. 



Piano, «Jack~, and Milton Greenberg, The -American 
Political Dictionary , Hinsdale, IL: * Dryden 
Press, 1967. • . 

Piano, Jack, and Roy Olton, International Relations 
Dictionary , New York: Holt, Rinehart k Winston, 
1979. - 

Raymond/ Walter J. Dictionary of Politics:. Selected 
American and Foreign Political and Legal Terms , 
Lawrenceville, VA: Hampton Institute Press, 1978. 

Reading, Hugo, Dictionary of the Social Science , 

Bo%toJK Rout Ledge jp ^eegan, 1977\ • 



ENCYCLOPEDIAS ' ' " 

Encyclopedias define both terms and concepts, and give much 
broader definitions than dictionaries. Like the dictionaries, 
encyclopedias can be either general or specialized. Two goad 
general encyclopedias are: , ' 

Cayne, Bernard, ed. , Encyclopedia Americana , DaribuiVi ^T- 
. Grolier Educational Corp., 1978. ^This 30-volume 
work is particularly good for information on- towns 
and cities. - ' 

Preece, Warren, ed., Encyclopaedia Britannica ,, Chicago; 
Encyclopaedia Britannica, iy?y. Another 30-volume 
work, recently revised in an attempt to make it easier 
to use, .this is the -most famous encyclope4ia in 
English ' — ai\d for some purposes the best. 

If you are looking for a more specialized definition, you 
might try:' f 

* ' ' j. 
DeCoi^de, ^Alexander, Eacyclopedia of American Foreign Policy 
New York: Charles Scribner's Sons, -1979. .This 
selective reference work contains especially 
Vi % commissioned articles dealing with the formative , 
ideas of American foreign policy; * % . 

.li, David, ed., International Encyclopedia of the 
Social Sciences , New York: Macmillan, 1977. This . 

-volume set was intended to complement its 
predecessor, Encyclopedia of the Social Sciences . 

. 57 . . V 




/ • • • 4 v • • 

q 

. Its primary focus is onl the rapid developments 

of the 196^0s, with femphasis on the analytical 
"and comparative aspects of a topic. 1 



EXERCISE 2,2: ^Dictionaries and Encyclopedias 

Choose three terms pertaining to your public policy issue, and 
list them under the proper heading. Then look up the first term 
in a general encyclopedia j the second in a general dictionary , and 
the third in a specialized dictionary or encyclopeffia. Note titles 
and definitions in the spaces provided n _ 



Term \: 



General Encyclopedia Used: <_ ^_ 

Definition: . 



Term 2: 



General Dictionary Used: 
Definition: 



Term 3: 



Specialized Kqrk Us§<T: ' 
Definition: 
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• III: BACKGROUND INFORMATION — JOURNAL ARTICLES 




Now that you have clarified your topic, you are ready to begin 
researching it. The next step is to locate some background infor- 
mation on your public policy issue. 

Journal articles can be used to provide .both background 
information and more information on the current status. of your 
_public^policy issue. _ Because of the huge number of articles pub- 
lished, a systematic method*~oT access"" ismeeded ' through 

abstracting and. indexing services. These sources serve as a list- 
ing of articles, most often by subject, and provide the article 
titlei author, journal, date, issue, Volume, and page number. 

There are five kinds of indexes: 

1. General indexes: These cover a number of periodicals 
on a number of subjects,. 

2. Subject indexes: These cover several periodicals on one 
general topic. 

3. Single title indexes: The.se cover only one publication • 

or title. , . 

* • * 

4. Newspaper indexes': Like^the single title indexes, these 
; sources cover only one title. Each index catalogues 

only one newspaper ? sufferings. 

5. Abstracts: These indexes, provide, in addition to the 
index information, brief summaries of the articles. 

/ Indexes are arranged alphabetically by subject, and occasion- 
ally by author as well. Since it is likely that you will be 
conducting a search by subject, you will be faced with the problem 
of what subject headings to look under?" 

There are two sources that' will help you locate the proper,, 
heading. The' Library of Congress List of Subject Headings will 
provide the subject heading used by the Library of Congress in 
cataloguing materials. This source, however, gives only Library 
of Congress headings, which may differ from the headings in an 
index or abstracting source. ~~ 
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-Another source that can be usecLJLs Tthe^xoss JR.eference Index. 



The Cro^s Reference Index lists the subject/headings used 0 by the 
Library of Congress, the New York Times , Sears List of Subject 
^ Headings , Readers 1 Guide to Periodical Literature , Business 
Periodicals Index , and PAIS . 

Indexes can be found to cover almost any area of interest. 
For public policy purposes, however, you will be interested in 
those abstracts and indexes dealing with the Social Sciences. 



GENERAL IND EXES ' f 

K 



Readers 1 Guide to Periodical Literature , New York: H. W. 
Wilson Co., 1900- . This index provides^ a well-balanced 
guide to nontechnical journals. Abput 169 periodicals 
are catalogued. 



SUBJECT INDEXES 

♦ ** 

ABC Political Science: Advance Bibliography of Contents : 
Political Science and Government , Santa Barbara, CA: 
? ABC-Chicago, 1969- . A servic^ listing the contents 
of the latest journals in the* fields of political 
science, government, public policy, etc. 

Bulletin of the Public Affairs Information -Service (PAIS) , 
« New York: PAIS, 1915-. This .multi-volume set 'is a 
subject index to current literatji^e on economic and 
social conditions. % A 

* i- 
Business Periodicals Index , New York: H. W.* Wilson Co., " 

1958- . A service that indexes 170- periodicals in various 
\ fields of business and management. 1 

Education Index , New York: H.'W. Wilson Co. ,-1929-. /This % 
is a cumulative subject index to about 240 periodicals 
in the field of education. 

Index of Economic Articles in Journals and Collective Volumes , 
Homewood, IL: R. D. Irwin Co., 1961-. The index lists 
articles from about 140 sources from various * countries. 

Index to Current Urban Documents , Westport , CT: -Greenwood 
Press, 1972- . This source contains originally indexed 
federal, state, and local documents. ; 
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Social Sciences Citation Index , Philadelphia: Institute for 
• Scienti^ic-Iivfomataon., 1973 - ^ An^JLnternational inter- 

disciplinary index to the literature of the Social 

Sciences. 



ABSTRACTS , * 

Abstracts on Criminology and Penology , Amsterdam** Excerpta 
• • Qriminologica Foundation, 1961- 7 An abstract journal of 
literature related to-*criminology . 

•Dissertation Abstracts International , Ann Arbor, MI: 

University Microfilms, 1938- . Abstracts of doctoral 
dissertations in three volumes: Humanities and Social 
Sciences, Science and Engineering, and European Abstracts. 

0 % Human Resources Abstracts , Beverly Hills, CA: Sage Publish 
tit>ns, 1975- . This covers material related to social^pd 
manpower problems. 

international Political Science Abstracts ,' Oxford: Inter- 
' national Political Science Association, 1932- . A source 
which covers articles in' the field of political science.- 

*p Journal of- Economic Literature „ Cambridge, MA: Harvard 
University, 1969-. This source, contains fLengthy 
abstracts from 35 journals-. (Formerly Journal of 
Economic Abst racts . ) 

Psychological" Abstracts » Lancaster, PA: American Psychological 
Association, 1927- . An important bibliography, listing 
and abstracting new materials yin the field. 

Sociological Abstracts , New York: Sociological Abstracts,, 
1952- . A classified abstracting journal that covers^a: 
broad range of topics of international interest. 

Women's Studies Abstracts , Rush*, l^Y: .Rush Publishing Co., - • 
1972-." This source^contains abstracts frdm a broad 
range of periodicals ,dealing with topics concerning 
women . * 
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EXERCISE 2 ".3: Finding Journal Articles - 



Part 1: Choose two abstracting or indexing services that could 
be used to find articles on your topic, and list them below 
in spafces provided. Under each source, list the subject 
headings usld in locating relevant articles ♦ 



Source 1 : 



Headings: ; 



9 



Source 2 : 
Headings: 



) 



Part 2: Giv'e.a one-paragraph summary of one of the articles. 

A 



v 



V 
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IV,: DESCRIPTIONS OF CONDITIONS — ALMANACS, YEARBOOKS, 

. AND STATISTICAL SOURCES X 



Often, in addition to background information, you will find , 
it necessary to seek information on conditions in the policy 
environment. This can usually be accomplished through statistical*, 
data as well as general descriptive information, • , » ' • . 

Almanacs .and yearbooks ^ give both statistical and general 
descriptive information in an easy-to-acquire format. Both sourees • 
are extremely useful in acquiring information on environmental , ^ 
conditions. * 



ALMANACS 



Information Please Almanac , New York? Simon & Schuster, 
1947- . 

Reader *s Digest Almanac , Pleasantville, NY: Reader- 1 s 
Digest Association, 1969- . 

The World Almanab and Book of^acts , New'YorK: Newspaper 
Enterprise Association, 1868-. m4 



YEARBOOKS 



American Foreign Relations, A Documentary Record , New York; 
Harper k Row, 1921-.^ \,. - 



T * 

The County Yearbook , Washington, DC: International City 
Management Association,* 197$-. , 

The ^Municipal Yearbook , Washington, DC: International City 
j Management Association, 1934- . 
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STATISTICAL SOURCES 



-CouncoJ of the States, feook of the States, Lexington,, KY; 



' The Council, 1935-. 

U.S. Bureau of the Census, City Government Finances , Washing- 
ton,' DC: Government Printing Office, 1909- . 
* 

U.S. i Bureau >of the Census, County and City Data Book , f 
^Washington, DC: Government Printing Office, 1949-. 

U.S. Bureau of the Census, State Government Finances, 
Washington, DC: Government Printing Office, 1915- . 

fJ.S. Bureau of the Census, Statistical Abstract of the 
U.S. , Washington, DC: Government Printing Office, 
1878- . 

Wasse'rman, Paul, Eleanor Allen, and ChaWlotte Georgi, 
Statistical Sources , 5th ed., Detroit: Gale 
Research Co., 1977. 



EXERCISE 2.4: Finding Statistics 

Select three statistics related to your public policy issue. 
On the next page, record them in the prdper places on tTie chart. 
Look up these statistics in one yearbook, one almanac, and »one 
other source. If ' the . statistic appears in the source, then note 
down the number; if not, then place a "0 M in the cell. For 
example, after looking up the number of states in the Information 
Pleage Almanac and finding that there were 50, the number 50 would 
be written in the row labeled r Unf ormation Please Almanac" 
(Almanac Title), and under the statistical column entitled "number 
of states."'! * * 
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t 

• 


Statistic 1 Is: 

* 


Statistic 2 is: 

r 

0 


Statistic 3 Is: 

o , * 


Almanac Titles 

\ 


• 




0 


Yearbook Title: 








■ * 

Other Source 
Title: 




t 


t 

c 
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V: EVENTS — NEWSPAPERS AND SURVEYS OF EVENTS 



N6w"*that you have background information and information on 
conditions on. your public policy issue, you can^begin to <|elve into 
the specifics of your topic. Since your public policy issue is 
probably an item of current concern, the best places to find infor- 
mation on events are newspapers and surveys of events. 

Every library will subscribe to at least one national news- 
paper, and most will subscribe to several / The larger national 
nejwspapers have indexes to the paper which will allow you to 
easily locate events pertaining to your topic. 

In addition to newspapers , surveys of events provide informa- 
tion on recent happenings. These sources tend to give more 
information and often include some background information on the 
topic. 



NEWSPAPER INDEXES 

Christian Science Monitor Inctex ^ Boston: Christian Science 
Monitor, I960-. 

National Observer Index , ' Princeton, N J : Dow Jones Books, 
1971- . 

Newspaper Index: The Chicago Tribune, The Los Angeles Times, 
The New Orleans Times ' — Picayune , The Washington gost , 
• -Wooster, OH: Bell i .Howell, 1972- . 

Wall Street Journal Index ,' New York: Dow Jones & -Co. , 195§-. 



SURVEYS OF EVENTS • , f < 

Annual Register of World Events , London: Publisher varies, 
, 1758- . . 

Congressional Index , Chicago : Commerce Clearinghouse f 193*7- . 

y ■ N 



G6 



Congressional Quarterly Weekly Report , Washington, DC: 
Congressional Quarterly, 1945- . - ( 

Deadline Data on World Affairs , Greenwich, CT: DMS, 1968- , 

— - o 

Facts on File, New York: Facts on File, 1940-. 



EXERCISE. 2.5: Finding Events 

Using the New York Times Index. , compile a list of three major 
events. These events should be specific actions of Legislation, 
judicial decisions, or significant actions of large .groups of 
people. Record the date and page number of the Times article. 
Next , look up the same three events in one other newspaper index* and 
one survey of event's, and record the dates and pages of the articles 
Since often these articles do not appear on the same day,, ox; even 
within the same, week, it is necessary to checK. the other sources 
sometime earlier and sometime a£ter v the event. If the event does 
not appear in the source, leave tjae box empty! 



o 


Event 1: . 

* * - 

> 


Event 2: 

■ 


Event 3: 

) r 


N.Y. Times 
Index x 


Date: 
Page No: 


Date: ^ 
Page No: 


Date:. * t 
Page No: * 


Newspaper 
Index #2: 


r«K- 

Date: 
Page No: 

i 


Date: 
Page No: 


Date? 
Page No: 


Survey qf . 
Events #1: 


4 i 

Date: 
Page No: 


Date: 

Page No: ^ 


Date: 
Page No: 



^ .VI: INFORMATION THROUGH DOCUMENTS — U.S. GOVERNMENT 

PUBLICATIONS 



Every year the United States government publishes thousands 
of pages of material on many different subjects. These materials 
can be very valuable in sttrdying public policy, , issues . * 

Before* you can locate documents on your subject, it is * V 
essential to identify the agency assopiated with your topic, since 
most government documents are authored by\ agencies, and not^ indi- 
viduals^ The United States Government Manual clearly, outlines the' 

purposes and structures of most agencies and departments. , * 

• § 

Perhaps the most important ' book *n your search is the Monthly 
Catalog of the United States Government Publications : If ybu 
know the agency assqciatfed. with your topic, simply refer to the 
author index in the back of the Monthly Catalog under thfii. agency 
and endeavor to locate any pertinent titles. The "List of Govern- 
ment Authors" at the beginning of the Catalog will tell you on 
which page* number the entries for your agency begin; If you are * 
not sure what agency is associated with your topic, or if th^re are 
several agencies in wived, you might wish to check the" subject A ^ 
index to publications in the Monthly ^atalog . /There is also a title 
index if you are searching for a specific title. 

Among other details, each entry in trie Monthly Catalog gives 
the entry number, the author, the title, the date, and the Superin- 
tendent of Documents (Su-Doc) number. o 

Documents may be arranged in your library in two ways, — either 
catalogued by. government author and shelved along with other books, 
or arranged according to Su-Doc number and catalogued by the * 
Monthly Catalog . Consult the^ librarian on how the collection is 
organized. ' * * , 

Should more information oii government documents be needed, 
Check: Joe Morehead, United States Public Documents (2nd ed., 
Littleton, CO: Libraries Unlimited,' T978). 
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. - ; BEST COPY AVAILABLE 

List of Government Autho£S_ . ^ . 

* - V . ' Beginning entry 

Administrative Office of United States Courts, Washington, DC 205f4 A <. t Ju 10. 14:976 

Aginfc Administration, Washington, DC 20201 :...„.»»..» HE 1.202:H 81 

• * Agricultural Research Service, Washington, DC 20250 t A 77.15:H-5-l,2 

Agriculture Department, Washington, DC 20250 A 1.2:H 81/2 

r ' Air Force Department, Washington, DC 20330 ; .> D 301.85:1 

Alcohol, Tobacco and Firearms Bureau, Washington, DC 20224 T ft).2:Al 1* 

Animal and Plant Health Inspection Service, Washington, DC 20250 ; . A 101.10/2:91-31 

Army Department, Washington, DC 20310 ?. t. D 101.11:5-809*12 

Assistant Public Printer (Superintendent of Documents) Government Printing Office, Washington, DC 

20402 , /. v GP 3.9:36/160-161 

Automated Data and Telecommunications Service, Washington, DC 20405 GS 12.13:976^-77 

Census Bureau, Suitland, MD 20233 r ' C 3.6/2:C 33/6 

Center for Disease Control, Atlanta, GA 30333 HE 20.7002iEn 8/2 

Central Intelligence Agency, Washington, DC 20505 .^Z.. PrEx 3.10:En 2 

Child Development Office, Washington, DC 20201 a ... HE 1.408:H 34 

Civil Rights Commission, Washington, DC 20425* - '.. CR l.2:C 49/5/976 

Civil Service <£mmission,,Washington, DC 20415 ,..>.. v * CS 1.2:Ag V£ 

Coast Guarji, Washington, DC 20590 T « TD 5.2:St 5 

Commissions, Committees, and Boards .....^..a*—. • *. ■■ Y 3.Ad 6:1/^24-75 a 

Community Health Services Bureau, Rockville, MD 20852 .....^ HE 20.5102:Ir 6 

Community Relations Service, Washington, DC 20530 h » J 23.1:975 

CONGRESS 

Congressional Serial Set 94:Cong.Serial 

Uws ., : <. 94.2:Pub.Law 469 

American Indian Policy Review, Commission o1^ashington,X>C 20515 Y 4.1n 2/10:F 31 ^ 

Congressional Budget Office, Washington, DC 2tJ$15< X Y 10.2 Ad 9/2 

Congressional Operations, Jo'int Committee on, "vVashington, DC 20515 * Y 4.C 76/7:C 83/976 

Economic Joint Committee, Washington, DC 20510 Y 4.Ec 7*F 73/5*/$70-74 

"""~~\ House of RepresentatiyelhVashington, DC 205 1 5 

\ House documents;.^. * :. * 94-1 :H.doc. 1 18 

House reports 95-l:H.rp.76 • 

y / Aging, Select Committee on, Washington, DC 20515 Y 4.Ag 4/2:El 2/12 

Agriculture, Committee on, Washington, DC 20515 v Y 4.Ag-8/l:M 66/3 

Appropriations, Committee on, Washington, DC 20515 .". ' ;Y 4.Ap 6/1 Ag 8/978/pt.2 

Armed Services, Committee on,' Washington, DC 20515 Y 4.An 5/2 a:977-78/10 

» Banking, Finance and Urban Affairs, Committee on, Washington, DC 20515 Y 4.B 22/l:Ex 7/10/977 

Budget, Committee on the, Washington, DC 2051* , Y 4.B 85/3:En 2/2/978 

Education and Labor, Committee'on, Washington, DC 20515 Y 4.Ed 8/l:R 21/3 

Government Operations,' Committee on, Washington, DC 20515 Y 4.G 74/7:Ac 2/8 

Interior and Insular Affairs, Committee on, Washington, DC 20515 - Y 4.1n 8/14:94-5/pt.2 

International Relations, Committee on, Washington, DC 20515 , ». Y 4.1n 8/16:H 88/17 

Interstate and Foreign Commerce, Committee on, Washington, DC 20515 Y 4.1n 8/4:Ai 7/34/977 

Judiciary, Committee on the, Washington, DC 20515 Y 4.J 89/1:94-49 

Merchant Marine and Fisheries, Committee on, Washington, DC 205 15 Y 4.M 53.95-A 

Post Office and Civil Service, Committee on, Washington, DC 20515 Y 4.P 84/10:F 31 p/975 

Public Works and Transportation, Committee on, Washington DC 20515 4.P 96/11:95-3 

Science and Technology, Committee on, Washington, DC 205 1 5 Y 4.Sci 2-.94-2/WW 

Veterans' Affairs, Committee on, Washington, D<2 20515 Y 4.V 64/3:M 46/10/975 

Ways and Means, Committee On, Washington, DC 20515 Y 4.W 36:D 71/2/974 

Senate, Washington, DC 20510 t Y I ?5^:E " 

Senate documents s . 94-l:S.doc.ll7 

Senate reports , ; 95-l:S.rp.30 

Agriculture, Nutrition, and Forestry, Committee on, Washington, DC 20510 Y 4.Ag 8/3:W 58 . n 

Agriculture and Forestry, Committee on,* Washington, DC 20510 J. f Y 4.Ag 8/2:Ag 8/24/977 

Appropriations, Committee on, Washington, DC 205 10 Y 4. Ap 6/2:Ec 7/3/977 

Armed Services, Committee on, Washington, DC 205 10........'. „ Y 4.Ar 5/3:D 61 
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MONTHLY CATALOG ENTRY 
NO.-The entry number is assigned 
after the records are arranged alpha- 
numerically by the Superintendent of 
Documents classification number. The 
first two digits establish the year; th< 
last four digits locate the record in 
the Catalog. 



SAMPLE/ ENTRY 



MAIN ENTRY -A main entry may 
be a personal author, a corporate author, 
a conference* uniform title, or the 
document title/ as established . by 
Anglo- A mencan "cataloging rule*. . 



i 

-i - 
I 

L-. 



TITLE PHRASE/ AUTHOR STATE- 
MENT -Title phrase and author 
statement are recorde'd from the title 
page, cover, or first page of the publica- 
tion cataloged. Material in brackets is 
supplied from other sources. 



IMPRINT-Thc imprint contains place 
of publication, issuing agency, and date, 
of issue. Includes name of sales agent, 
if any. 



i 
i 

r* 
i 

i 
i 
i 
i 
i 
i 

-J 



COLLATION -Collation notes pages, 
illustrations, and size. 



SUBJECT HEADINGS (Arabic 
numerals) -Headings are selected from 
Library of Congress subject headings. 
Some local and NLM subjects will be 
used. Local subjects^wtll be indicated 
by a star (&). NLM will be indicated 
by an asterisk (•). 



r* 

i 

i 

i 

i 
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LIBRARY OF CONGRESS CLASS 
NO. -This is given wTten it appears in 
the publication or the OCLC data base. 



.-J 



-76-1435 

A 1.9:2148/6-*-— - 

-Reid, r William J. 

— Aphids on leafy vegetables : how to control them 
/ [by W. J. Reid, J r. t and _F F\ C_ut hbert L J r. ]_ 
[ Rev. Fetf!*i ^6]^asli]ngtonf r07sj5ept7 of Agri- 
culuTrerAgJicuftuial Research Service : for %ale by 
the Sup.t. of Docs., .U.S. Govt. Print. Off.> (1976] 
—-►14 p.: ill.; 24 cm. -(Farmers' bulletin; no. 2148) 

"fhis publication isjntended for the commercial ? 
grower of those vegetables whose leafy or flowering 
parts are marketed." 

Item 9-* — t — z w 

S/N 001 -000-03478- 

pbk.: $0.35*—- 

^1. plant lice - Control. 2. Insecticides. I. Cuth- 

berCFrank P.JJInt author. II, United States. Agri- 
cultural Research Service. III. Title. IV. Series : 
United States. Dept. of Agriculture. Farmers' bul- 
letin ; no. 2148.. : ~ 
•- *-S2LA6 rev. no; 214$ 1969 72-604400 
^632/.7/52 . * T 
OCLC 0084699 

* * ' 



DEWEY CLASS NO.-Dewey class 
is recorded if it appears in the Ohio 
College Library Center data base. 



...J 
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SUPT. OF DOCS. CLASS NO.-This 
is the number assigned by the GPO 
Library to identify the document 
cataloged. * 



EDITION -The edition is recorded 
from information in the document. 



SERIES STATEMENT-This appears, 
in parentheses and includes the phrase 
identifying the document as one of a 
series. 



NOYES.- Notes include miscellaneous 
information about the physical makeup 
of a publication or about the informa- 
tion contained in it. 



ITEM NO.-This document was 
distributed to depository libraries re- 
questing this item number. 



09 

TO 
C/J 

O 

,s 3 



—I 
i 



.STOCK NO.-This is a Government 
Printing Office sales Stock number^ 
It is used onlyr in ordering from the 
Superintendent of Documents. 



8 2? 



t /asm 

ST 38 * 



PRICE- Price. GPO or other, is 
included if known. " \ 



L 



A DDED ENTRIES ( Roman nu- 
merals)— When the Government author 
is not a main entry, it is included with 
added entries. 



OCLC NO. -This is the number as- 
signed by the Ohio College Library 
Center to identifythis record in the data 
base. 



LIBRARY OF CONGRESS CARD 
NO.r- Included for libraries ordering- 
printed cards from the Library of 
Congress. 4 ■ 



/ * 
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EXERCISE 2.6a: Finding Government Do^ptaients 

Uteing the United States Government Manual , determine which 
agency is associated with your v topic. 



My Argency Is 



1. 



2. 



3. 



locate three publications relevant 
number, the title, the author, and 


to 
the 


your topic and give the 
Su-Doc number. 


r 
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CENSUS *DATA 

» 

A special type of government doeument^isJin format ion published 
bjA the United States Bureau oiS.t^e Census. Every 10 years the 
Bureau collects' information on population and housing for the entire 
country. This information is updated within the 10-year period 
through estimated and sample survfeys. ~ ?_ 

The- Census Bureau .breaks the nation down ijn several ways. 
These are: 

1. Regions'/Division. There are four census regions (west, 
south, northeast, and north central) defined for the United ^ 
States, each composed of two' or more divisions. Divisions 
are areas composed of groupings of contiguous 'states . 

2. Standard Metropolitan Statistical Areas (SMSAs). In 1970, 
an SMSA comprised a county containing a central city (or 
twin cities) of 50,000 or more, plug contiguous counties 
which were socially and econpmically integrated with the 
central coupty.* All counties in 'SMSAs are termed "metro- 
politan," and all others "nonmetropolitan . ,f * 

no 
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3. Urbanized Areas-(UAs) . "UAs comprise a central city of an 
SMSA, plus the "surrounding closely settled urban fringe ^ 

" ("suburbs"). 

4. Urban/Rural. The urban population ^comprises all persons 
living ^in urbanized areas and in places of 2,500 or more 
outside urbanized areas. Everyone else is considered 
rural . * 

5. Unincorporated Places. A concentration of population which 
is not legally incorporated. Suitable boundaries are 
defined for statistical purposes by the Census Bureau with 
local assistance. Unincorporated places of less than 1,000 
inhabitants are disregarded. 

6. Census Tracts. Subdivisions of SMSAs averaging 4,000 popu- 
lation, covering all SMSAs for 1970. Tracts are defined by 
local committees and are frequently used to approximate 

neighborhoods. , 

t 

7. Enumeration Districts (EDs). Administrative divisions set 
up by the Census Bureau" to, take the census in areas where 
enumerators were used, averaging 800 population. Outside 
of urbanized areas, thijs'is the smallest geographic unit 
of analysis, and all other areas (tracts, places, MCD^T"* 
etc.) can be defined as a collection of EDs. 

8* • Block Groups' (BG^) . Groups of city blocks, averaging 1,000 
population, which take the place of enumeration districts 
m in 145 large urbanized areas where' the census was, taken' by 
mail in 1970. ; 

9. Blocks. City blocks are areas generally bounded by four - 
streets or some other physical boundary, Refined in urban- 
. ized areas and in additional cities which contracted with 
the Bureau for collection of block statistics. 

The Census- Bureau. gathers information on many items under the 
,two main headings of population apd housing. Information includes 



» , • 
Population Items > 
Relationship to head 

of household 
Color or race 

Housing Items 

Number of housing units 

at this address 
Tel6n>hone 

Complete kitchen facilities 
Rooms 
r Water supply 



Age 
Sex 

Marital Status 1 



Flush toilet 
Bathtub' or shower 
Owner/renter 

Commercial establishment 

on property 
Value 
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The information gathered is compiled in a series of reports 
covering a variety of areas and subjects. To find a specific 
subject the best source is Index to Selected 1970 Census Reports . 
A general guide to the rise of census data is the 1970 Census 
User 1 s Guide d Both of these publications are available from the 
Data User Services Division, U.S. Bureau of the Census, Washington,, 
D.C. . 



EXERCISE 2.6b: Using Census Data ^ , 

• Choose an SMSA (Standard Metropolitan Statistical Area), per- 
haps the area in which you live. 



My SMSA Is 



Using a Census Tract report for this SMSA, locate the follow- 
ing information* for your SMSA. (Table number is giy'en.) ; • 

Table * ; 

Number • - Data 

1. P-1 Total Population 

2. P-1 Percent Negro' - 

. 3i P-1 Number of Persons 

65 and Over ) 

4. • P-1 Average Number of Persons 

Per Household : 

5. ? P-4 . Median Family Income^ 4 m * . 

■* • 

6. * P-4 Percent of, Families ^ 

Beloy Po.Verty Level 6 

In completing this exercise, be^sure to use the SMSA 
statistics, not the tract statistics. 



I 
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VII. INFORMATION TOOL — USING MICROFORMS 



In your search thus far, you have probably encountered micro- 
forms. In order to save space, back issues of many newspapers, 
some periodicals, and numerous U.S.; government and international 
documents are put onto microforms. This process makes it possible 
for a library to hold much more in the way of past issued, and 
provides a way to keep material without having to worry about the 
decay or destruction of the printed material through age or 
constant use. T 

There are several ytypes of microforms: 

• • _ 

1. Microfilm: Microfilm is a reel of film, usually 100 f£et 
(30m) long and 16mm or 35mm wide, containing photo copies 
of the material. It is the standard format for back- 
runs of journals. 

2. ..Microfiche: Microfiche is a piece of exposed film, usually 

4 inches by 6 inches., containing either 60 or 98 frames or 
pictures on a card in a grid pattern. 

* 

3. Micro-opaque: Because of the cost and difficulty of 
manufacture, these microforms are becoming obsolete. 
Micro-opaque is ah opaque card with information printed 
on both, sides. Unlike microfilm a^^microf iche , micro- 
opaque is read by reflecting light off the surface rather 
than shining light through it. 

' a) Microcard: Microcard is a 3 inch-by-5 inch piece 
of micro-opaque. w 

b) 'Microprint: Microprint cards are 9' inp^-by-6^ inch 
micro-opaques . ' 

If you are interested in acquiring further information on 
microforms, you might try the following: 

Dissertation Abstracts International , Ann Arbor, MI: Uni- 
versity Microfilms, 1939-. Catalogues and abstracts 
doctoral * dissertat ions . s 
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National Register of Microform Masters , Washington, DC: 

Library of Congress,. 1970- . Catalogues all material 

except newspapers, and theses. 

> 

Newspapers in- Microform , Washington, DC: Library of Congress, 
•1970- . Catalogues all newspapers on microforms. 



EXERCISE 2.7: Microforms 

Using a newspaper index such as the New York Times, locate an 
article that provides either historical or general background 
information on your topic. Have this article reproduced onto . 
paper and attach it to your- paper. 



**** 
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VIII: IN-DEPTH INFORMATION — LOCATING BOOKS 



While much of the reformat ion'-you require for your research 
can be found in journal/ and newspapers,' often you will find a need 
for more in-depth, detaliled information. The best source is books. 

Locating books in a library can be difficult, but if you 
acquaint yourself with the system of organization in your library, 
the job becomes much easier. At present there are two major coding 
systems for organizing a library collection, the Dewey Decimal 
System and A the Library of Congress System. . \ 



a The Dewey System divides all books into 10 major categories* 
each category bearing a number.* S~ 

( 1 

The major divisions are: 



'ft 



000 - General Works , ^ 
iQ0\- Philosophy and Related Disciplines 
200 ^ Religion 

300 - The Social Sciences % 

400 - Language * 

* 

500 - Purei Sciences 
600 - Technology (Applied Sciences ) u 
7X)0 - The Arts 7 
800 - Literature and Rhet6ric 

900 - General Geography and History and Their Auxiliaries 
(including biography) c v 

Each of these categories can be divided into 10 more sub- 
divisions. Since we, are dialing primarily with the Social Sciences, 
it is useful to know how the Dewey System breaks down the 300 
.category: 
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300 - general s 
310 - Statistics 
340 - Law ' 

320 - Political Science 
330 - Economics « 



350 - Public Administration 

360 - Welfare 

370 - Education 

380 - Commerce 

390 - Customs and Folklore 



Under the Library, of Congress System, the books are coded by a 
combination of' numbers, and letters. The first latter (or just two 
letters) denotes the subject heading. J* 

The classifications are: 

A - General WorKs and Polygraphy 

B - Philosophy and Religion 
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C - Universal History 
E-F - American History >^ 

G - Geography and Anthropology . % 

H - Social Sciences 

J - Political Sciende s 

K - Law - v 

L w/E<iuca.*t ion \ " 

M - Music 

N - Fine Arts 
P-0 - Language and' Literature 

Q - Science ^ ' 

<« 

R - Medicine 
, S - Agriculture / 
T - Technology 
U - Military Science 
V - NavSCl Science 

Z - Bibliography and Library Science 
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By knowing these classification systems, you can tell to some ex- 
tent, by looking at the number, what the t^ok is about and whether 
useful to you. ^ 



The first step in looking for books is t/o determine what the 
vcode on the book is;, Th,is is done through the card catalogue. 

The card catalogue generally contains at least three cards for 
every book in a library collection — title card, author card, and 
subject card. For the most part, these cards contain ths same 
information, but^ are filed differently in the alphabetically 
ordered catalogue. 

* Each card contains information on title, author(s) or editor, 
place and date of publication, number of pages, size, contents, 
call number,, and. tracings. The tracings indicate other subject 
headings under which this* book is located, and can also lead to 
additional titles on the same subject. Some bboks have tracings 
on" all thre6 cards, but .others list tracings only on the author 
card. 

. The card catalogue will be one of. two typ^s, divided or non- 
divided. . The divided catalogue will have author and title cards 
in the same file, with the subject cards filed separately. > The 
nondivided dictionary catalogue will have all s three types of cards 
indexed together in the same file. 

The best place, to begin your search is under the subject. Yqu 
know what your topic is, and what subjects may be related. Go to 
the sublet part of the catalogue and look up your . subject . If you 
cannot find a ^related subject listed in tha card catalogue, check 
the Library* of Congress List of Subject Headings . 

Once you have identified the book you want in the card cata- 
logue, you/n(ust locate it on the shelf. Note the call number in 
the upper/ left corner of the card which is the code, either Dewey 
or Library of Congress, for your book^ Tfien proceed to the stacks, 
arranged numerically for the Dewey and alpha-numerically for the 
Library of Congress, and locate your book.* 



ERCISE 2.8: 




Part 1: Using **fhe system described above, locate and list three 
,books related to your topic an.d give full bibliographical 
citation . <~ 

For e^mple: -Coplin, William D., and Michael K. O'Leary, 
^ f ^ Everyman's PftlNCE , North Scituate, MA: 



Duxbury Press, 1972. 
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2. 



3. 



Part 2: Give a brief summary of what information on your topic 
two of these books would provide. 




• ( 



«- 



i 
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IX: . THE LfiGAL SIDE 

***** 



A* " Legal Dictionaries 

Often when dealing with a public policy issu%, you will wish 
to check into the policy aspect of your topic by researching in a 
law library. Before the law library can- be effectively used, it 
must be determined how certain facets of your topic are defined 
under* the law. To accomplish this, a specialized le^al dictionary* 
should be consulted which will supply legal definitions of » words 
and phrases. ' • 

Two good legal dictionaries are: 

Ballantine's Law Dictionary with. Pronunciations (William 
Anderson, *ed. ) , Rochester, NY: Lawyers Co-operative 
Publishing Co. , 1969. * v_ 

Black's Law Dictionary , St, Paul, MN; West Publishing Co./ 
1968.. ' 



USING THE LAW LIBRARY 



EXERCISE 2.9a:. Legal Dictionaries 

Select one broad term or concept related to your public policy 
issue. Look it up in a legal dictionary and identify the diction- 
ary used. • • 

Term: • 



D^f-i*rition: ^ 
Dictionary: 



7=^ 
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B. Legal Periodicals 



V ■ 



A good starting point in becoming acquainted with the laws 
governing your topic is to check legal, periodicals^ These contain 
articles by established scholars,, studenp comments, and case notes, .J 
reflecting analysis of -changes in the lsk as. well as historical 
developments. ^ 

To gain accsfes to law journal articles, check the, Index to 
Legal Periodicals . This source indexes over 350 periodicals by 
author, subject, cases, and book reviews. * 



EXERCISE 2. 9b: .Legal Periodicals 



Part 1: Using the Index to Legal Periodicals , locate two journai 
articles on your topic and give the full citations:- 



Article 1 



Article 2 









0 


















0 








* il" 
















~ •( 













Part 2: Locate , a copy of one of the articles and write a brief 
summary below. 
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C. Statutes 



* In 'order to find M the law, 11 you must have some understanding 
of governmental organization. Our government is composed of three 
branches, each of fthich effect the law in their own way. 

f The legislative- branch of government, tjie United States Congress 
determines what the laws should be. A statute is a law that has 
been passed by a legislature and written down. v 

The federal statutes are found in 'the U.S. Code , an official 
soifrce issued by the United States Government Printing Office. Un- 
fortunately, this. source can run up to two years behind schedule. 

'Two more up-.to-date, albeit unofficial, sources are U.S. Codes 
Annotated , a West publication, and U.S. Code Service , a Lawyers 
Co-operative publication. Better indexed and much easier to use," ^ 
both sources are indexed by subject , fi include case references, and 
are updated at least once a year s ^ 



EXERCLSE 2.9c: Fining* Statutes \A 

Using U.S.. Code Annotated or U.S. Code Service , lo<mte a fed- 
eral statute in any way related to your topic. Give the%itle and 
volume' number in which your statute appears, and the date tfre law 
was enacted. 

f 

The Title Is *■ 

/s . . . 

Section Number N - . Date of "Enactment 



'D. y.S. Supreme Court Cases 



The judicial branch of government judges people under the law' 
and, through the U.S. Supreme Court, can decide the 'Shape the law' . 
will take. For this reason, you will want to check, on Supreme 
Court decisions in your topic area.. - ' 

x The official cojirt reports .are published as United States Re-* 
ports . Two'unof f iciil sources of Supreme Court decisions are. 
Supreme Court Reporter (West publishing Co.), and Lawyer's Edition 
&f thg U.S. Supreme Court Reports (Lawyers Co-dperative) . These 
are indexed by Strttject in two unofficial .publications 'entitled 
Supreme Court Digest (West) and Digest of the U.S. Supreme Court 
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Reports (Lawyers, Co-operati^ge) . These sources render citations in 
an easy-to-use fWm. 



EXERCISE 2.9d: Locating Supreme Court Cases 



Part 1:' Using the Supreme Court? Digest or Digest of the U.S. 
Supreme Court Reports , locate a decision by the Supreme 
.Court 'related tb your topic area. With the citation informa- 
tion you find, identify the case in the, United States Reports , 
the Supreme Court Reporter , or the Lawyer's Edition of the , 
U.S. Supreme Court Reports . Give the name of the case and 
the date it was decided. 

N 

Name of Case: ' 4 . \ 

~T~ ~\ 

, * 

Date Decided: ; 

(Day, month, year) m 

Part*- 2 z Write a short summary "of what the case was about. 
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£. Administrative Regulations 

The third branch of ^vernment , the executive branch, sometimes 
legislates through federal agencies. An agency will issue rules 
and regulations to control a certain program' or to- enforce a law; 
these regulations have the force of law. 

' ' The Code of Federal Regulations (CFR) , a compilation of all 
federal rules and regulations, contains information about the 
organization of agencies, as well as the rules and regulations 
issued by "an agency „ 

The daily supplement to the CFR is entitled the Federal 
Register . A rule or regulation cannot be enforced until it is pub- 
lished in' the Federal Register which contains proposed regulations,- ' 
notices, and amended rules -and regulations for administrative 
agencies. 



EXERCISE 2.9e: Locating Regulations 



Part 1: Identify the federal administrative agency associated with 
your topic. Using the index to the Code of Federal Regulations, 
locate the volume in/which imany of/your agency's rules and regu- 
, lati^ns appear. V. 

The Volume Is [ * * 

Part 2: Using a recent issue of the Federal Register , identify a 

proposed regulation, a notice, or an amended rule^or regulation 4 
concerning your agency. Should additional information be needed, 
.check two'books by' Morris L. Cohen,' Legal Research in a Nutshell , 
2nd ed. and How To Find' the. Law , 7th ed. (St. Paul, MN: West » 
Publishing Co., 19.71 and 1976). Describe below. 
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X: THE FINAL RESOURCE — USiNG BIBLIOGRAPHIES 



A final source in your search for information is Jthe biblio- 
graphy, defined as lists of materials in given subject areas. 
Bibliographies can be very bxoad or very specific. Besides books, 
there are bibliographies of magazines, newspapers, government public 
cations, and microform. 

** 

A [few examples of bibliographies in the public policy, jirea are;. 

Besterman, Theodore, Bibliography, Including Library Science 
and Reference Books , Totawa, NJ: Rowman and LittLef iel v d, 
1971. . \ m****** \ 

V 

Bogdanor, V.B>, Bibliography for Stjudents of Politics , Fair lawn, 
NJ: Oxford University Press, 1971. (v .- 

Delupis, Ingrid^ Bibliography of International Law , New York: 
R. R.' Bowker Co., 1976. 

Sheetiy, Eugene, A Guide to Reference Books , Chicago: American 
Library Association,- 1976. > • s 

Une&co International Committee for Social Science' Document at i^on, 
Internatipnal Bibliography of Economics , Vol. 1, Chicago: 
Aldine Publishing Co. , 1952-. • -V 

UneSco International Committee for Social Science Documenta- 
tion, International Bibliography of Political Science , 
Vol. 1, Chicago: Aldine Publishing. Co. , 1952-. 

Unesco International Committee fot SociaJ. Science Documentation, 
International Bibliography of Sociology , Vol. 1, Chicago: 
uridine Publishing Co. ; 1952- . . ' . 



t 



EXERCISE 2.10: Using Bibliographies . *' 

Locate three titles tha-fSRight be of value for your topic. Note 
which bibliography was used and supply full citations for the b'ooks 
found* - % ' 



\ 
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The Bibliography Used Was 



Title 1: 



Title 2: 

>. 

Title 3: 
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CHAPTER THREE: INTRODUCTION TO SURVEYS' AND INTERVIEWS 



THE PRIMARY OBJECTIVE: 



To introduce the student to the concepts and skills us-ed 
to conduct a sample survey. 



UPON COMPLETION 'OF THIS CHAPTER, YOU WILL BE ABLE TO: 
*. Plan' a, simple sample survey^ 

* Identify various designs used to qpllect 'data % 

* Identify ■ various sampling procedures. 

* Define and apply basic jstarvey concepts* % 



(Based on PS-12:: * Introduction 'to Surveys and Interviews , Lawrence 
P. Clark, Croton-on-Hudson, NY: .Policy Studies Associates, 1976.) 
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I. INTRODUCTION TO SURVEYS . 



Over the years, the sample survey has becomes common pari 
of the American culture. From the backwoods of Washington St-ate 
to the urban centers of the East coast, surveys are used to collect 
data on all types of questions from all kinds of subjects. The 
Gallup or Harris polls are familiar indicators of public opinion.- 
In an election year, America is constantly bombarded with the 
results of, surveys showing that this candidate or that one is ahead 
in- different parts of 'the country** 

What then is a survey? A survey is a process of gathering 
information afcLout a group of subjects in which direct contact ^is 
made with those subjects^ The subjects of a survey could be people 
organizations, contaunitlfes, governmental bodies, etc. The typical 
survey uses such techniques as the questionnaire and interview 

schedules tio obtain information from the subjects* 

• i 

A sample survey is different from a census or a poll. In a 
sample survey, information is^ collected from a fraction of the 
total number of subjects who are chosen to represent the total. ^ , 
A census is a type of survey in which data is compiled on .all the 
subjects of interest. The term "poll'' Is used to**describe «a survey 
dealing with, public opinion concerning elections or pther public 
issues. * 

The major power of a survey lies in its ability to provide* 
answers to such questions as.: Who does what? Why? How? How 
well? With what effect?, , Throughout this chapter, a f ictitfb'tfs 
survey on, food will be used to illustrate various points. A sample 
survey, could help to generate answers to one or more of the follow- 
ing questions concerning food: ^ 
* ** 

1. What are the characteristics of vegetarians? Are some 

parts of the country more likely to have vegetarians than 
other regions of the* country? - * . 



2, Why do^gtoraife families . like having meat *with every meal? 
h Why do some people choose to use margarine in place of" 
butter? 
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3. How did families cope with the rising food, costs of 
1973-74? How are the menus composed for each meal? 

4. How well does the -food stamp program work? -How well 
did .a local nutrition education program work? 

5. What were the effects of the closing of a local super- 
market? What were the effects of the recent sugar 
shortage? ■ 



The answers to these questions allow the surveyor to make . 
statements concerning the subjects under observation, i.e., state- 
ments he hopes represent the opinions of the larger population of 
- subjects from which the sample. was drawn. The surveyor might want 
to use such statements as part of a study performing one or more of 
the following types of analysis: 

Description of the population : What characteristics dp 
the 1 subjects in the survey 'have in common? / \ 

Causal explanation : Why did something happen the way it 
did?. Was the hypothesis put forth to explain the change 
correct? 

-Prediction of future conditions: What can*be expected to 
-happen next month, next year, or over the next decade? 

Evaluation of social programs : Did the program accomplish 
'. the goals for which it was designed? Was this particular 

program an efficient way of. reaching those goals? » 

Development of social indicators : How satisfied are certain 
subgroups of the population? What is" "the current feeling . 
' 'about "the quality of life in the United States? 

As you progress' through this chapter, you" will examine the 
various stages in the, design .and conduct of a sample survey which 
' would help you to answer some of the questions posed on the pre- 
vious pages. . ' • 
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II: DESIGNING A SAMPLE SURVEY 



The design of a sample survey is a v planned schedule for . 
collecting and analyzing the data required to satisfy the research 
objectives. Most surveys will ha\^e one or more of the following 
research objectives in mind when they are being designed: explana- 
tion of the various factors composing an issue; explanation of the 
vcauses of an issue; testing hypotheses about an issue; predicting 
future trends or events related to an issue; and the development 
of social indicators. 



Exploration 

There are many situations where the researcker simply does not 
have enough knowledge • about the issue to really % know" where to 
begin. He^miglit be tempted to do a survey in which the bulk of the 
questions were of the form "Wtiat sorts of things aggravate ybuith'e 
most about, this particular issue?" or, "What are tHb#good points 
of this .i^sjie?" The problem wfth questions of this mature lies 
in the ability to interpret the answers received which will range 
from a Monosyllabic response to a half-hour speech on "What is 
Wrong with the Country." It will be extremely difficult, to make any 
statements about the population from' which the sample i* drawn. 
For these reasons the sample survey is not trie most efficient 
instrument for exploratory research. | < 

Description * 
• • 
The aim of descriptive surveys is td measure certain items 
such as food preferences, religious affiliation, income, or^di}- 
cational achievement. The description of certain phenomena of 
interest , can fill in the background neoessjiry t v o formulate "other 
research objectives that the survey sponsor might consider* investi- 
gating at a later date. * • m \^*J* 

' Causal Explanations ^ • 

. A Survey "aimed at measuring causal explanations attempts to 
explain why an event or situation happened the way it did and what 
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factors influenced or caused the final outcome.' . To' demonstrate a 
causal relationship between factors and outcomes, three conditions 
must be satisfied. First, the factors which the researcher believes 
cause the outcome and that outcome must be associated with each 
other. That is, when the causal factors are, present , then the out- 
come must also be present, at least under certain definable circum- 
stances. The second condition is that the presumed causal factors \ 
must occur before the reported outcome, or at a minimum., the out-, 
come should hot take place before the causal factors. The final 
condition that must be satisfied be.fore a causal relationship can 
be established between. factors and outcomes is th^ elimination of 
all other rival explanations for the reported outcome. When these 
three conditions have been met, the researcher has a case forj 
believing that the factors he or she investigated did indeed cause 
the reported outcome. For example, the researcher naight be inter- 
ested in ascertaining if the cutbafck in a number- of policem£D_d.ue. 
to budgetary pressures was responsible for the most recent increase 
in crime. Or he/she'migbt want to know if the rapid rise in food 
prices o.ver the last few years has caused a shift in the eating 
habits of Americans. « , 

'However,- with sample surveys the researcher rarely/can ade- 
quately satisfy all three conditions, particularly the last, and , 
therefore must, be especially careful wheri using a sample survey as . 

a causal explanation of a phenomenon. * 

i 

Testing Hypothes-es 

•'- * • \ i ' • - 

This research objective is. closely- related to causal explana- \, 
tion. In order 'to sky that a factor influenced or caused 'a 
reported outcome, underlying assumpt4ons jntst exist about their_ 
relationship. Those underlying assumption* are called hypotheses. 
A hypothesis is a statement whose truthfulness can be tested by 
empirical data. Hypotheses usually take the\form of a statement 
expressing a causal relationship, for example, "a drop in the ■ 
price of beef will cause a' rise in the national rate of beef 
'consumption." The statement "God is responsible for the fevents 
which happen in our daily fives" would not be a hfrp3"tkesi4s , even 
though ma'ny people believe the statement, since it is not possible 
to, determine if there Is a God by using empirical data. The ability 
to formulate hypotheses is valuable in the planning and designing 
of surveys since it forces the researcher to think about just what 
he expects to find using phe survey:- • ' • 

« Evaluat ion * - t < 

The eAraJuatioii. of planned programs of intervention is an 
increasingly ^ffOpulW iise to which surveys are put these days. 
. For example, a local city, government., may want to know, if a social 
grim- designed, to change people's attitudes towards nutrition 



program- ae sign eu. iu uimugc ^j/^ ^ - ; , 

does in fact.*change their attitudes. A state government might want 

* 
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to know what changes should be made in an after-school cultural 
enrichment * program so that more children would attend. In each 
case, the sample survey is one instrument that the sponsors could 
' use -to obtain the information they desire. f 

Designings survey for evaluation involves making decisions 
about ,the objectives of the sponsoring agency. Evaluation research 
can be broken down into two broad categories related to the focus 
and the time frame of the devaluation • In sujnmative research, the 
objective of ^he evaluation is twstudy the effects of the social 
program — i.e., did it accompl ish .the goals it set out to achieve? 
In formative research, the evaluation is concerned with the 'ongoing 
process of the social program and methods of improvement. The 
evaluation pf a nutrition program conducted by a local city govern- 
ment is an example of an evaluation concerned with ef f ects ^ that 
^JLs^the outcome, of the program? A state evaluation of an _e.ducj^_ _ 
tional enrichment program is an Qxamnle of an evaluation which is 
directed toward the ongoing process %f a program. Some evaluations 
assess only the short-term effects- of the program while others are 
aimed at th^) program* s long-term impact. The short-term evaluation 
is a fastear and cheaper method, although it maj^iuffer from having 
an' overly /narrow focus. The long-term evaluation, while more 
comprehensive than a short-term evaluation, may require more 
financial resources than the agency has available. 

V 

The question of whgtt should be evaluated, and how, raises the 
problem of bias, along with potential ethical and political prob- 
lems. Does the researcher use ttie yardstick for success employed 
by the sponsoring agency, or should the evaluator exercise £n 
independent point of view in determining* success or failure of the 
program? For example, consider a prograrn designed to teacji high 
school student^ the basic fundamentals of comparative food shopping. 
One way ofl measuring the success of the program is to evaluate the. 
•students 1 scores on a standardized questionnaire designed to measure 
pretention of the material covered. "Although this criterion of 

success might satisfy school administrators and teachers, there^gire 
other criteria that can also be used. One could -measure the degree 
to which the students sjhare the information with their families, to 
what extent they actually use the information when in the super- 
market, and the length of time they retain and use the new infor- 
mation. — — " ~* " 

It should be evident that the. way in which success or failure 
is measured will involve political decisions. Any social program 
will appear to be more valuable when measure^Lby ^certain .criteria 
and not by others. Thus, the resea&cher 4 may -be under strdngr 
pressure to use criteria influenced by various interested parties 
or shaped by his or her own* personal values. The best way to avoid 
an evaluation bias toward the interests of one party is to ctmsult 
With all interested parties during the planning^ stages. 
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Prediction 



) 



— -sSample surveys are most often used to predict the future. 
Publifc opinion polls reporting voter preference in an upcoming 



FUDJLXC Opinion puilb iwpuiii"B vw„^ — - T V 7 . -jt - ----- 

election are a common example. Other examples might include . 
surveys used to predict future automobile' sales , the size of future 
wheat deals with Russia, or the number of college students who will 
be enrolled in the year 1985. 

\ ' . - 

Social Indica tors * * 

In recent years, surveys have been employed to develop social 
indicators .which, it >s hoped, will provide a" measure of the 
social and -political feeling in the country comparable to the 
economip 'infijfrcators used to measure the s^ate of the economy. 



Conclusions 

Surveys can be designed with many research objectives in mind. 
Some of these include: \ / 



« 

Exploration of the various factors composing an ^ssue. 

Descriptions of the geople, events, or phenomena involved * 
with an issue. t * 

Prediction of future tr.ends or events related to "an isj#<fe. 
-Development of social indicators. 



EXERCISE 3.1: Research Objectives for a Sample Survey v 

Using your public policy issue as a topic, write out the 
major Research s objective(s) ypu hope to accomplish with your 
sample survey. K ~ 



r 
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III: TARGET POPULATION 




The results of any survey will generalize only to the popula- 
tion from which the sample is drawn* 'Thus, it is necessary to 
k_jdevelop a concise definition p.f the target fk population — that 
group of- subjects' about which information is desired. If the 
* * study is interested in national opinion about doctors 1 strikers, 
jt&^is not enough to ^ftudy Washington, D.C., Troy, New York, or 
Pullman, Washington. ' . P 

' In order to begin to define the -target population, it is 5 
necessary* to designate the geographic or physical limits to be 
included in the •survey. For example, is the survey a national 
* / on<e covering all ; 50 states, a survey pf local schools, or a 

survey ,of statewide agencies? After the geographic "limits have 
been formulated, the next decision to be m2de is. to establish • 
• wliat population or populations within that ayea* are of interest; 

that is, what groups of subjects does> the surveyor want to 
able to generalize about? One survey "cbuld examine several 
different, lobulations using the same set of respondents at the 
same time. " For example, a citywide" survey of police precinct * 
stations might consist of a survey of the. buildings themselves, 
f the number'^f jai^ tells, offices*, .arid -committee rooms in each 

station. ^-^Hhsecond. population might b.e concerned with the police- 
men im the one station; how many *here are and what thetf do 
during a£ 8-hour shift. A third possible population that might 
be covered is the officers in each station ; v how many hours of 

9 community relations-type activity/ they are' involved in, how aften 
they p&trol the street^., Using the example of the sample survey 
on food, one population o;f interest plight be heads of households, 
another teenagers, apd a third', the kitchens in each' of. the homes. 
In eafch of these examples*, thei^e'is s'ome^ overlap of populations 

, fox instance, one might be the* head of a Household and' a teenager 
at, the same time. If the survey is -directed toward including ♦ 
possible subgrdups of a, popu.latiQn, pHen it will be able to make 

- generalizations about each subgroup.' A Survey designed to cover 
both- heads of households and teenagers <who -are food consumers « 
t t 'wo]il°d be, able' to make" statements 'about both teenage heads of 
.households as food consumers and* teenagters as food consumers. A' 
survey which has ks its tajrget ftogulation only heads of households 

*would be able to generalize about teenage heads 6f housholds as ^ 
*• * * 
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food consumer*, but * worn d not be able to make statements concerning 
teenagers as food consumers, even though some, of the heads of t ~ 
households mal havje befen teen-agers. The question of pinpoint^Hg 
the- survey's target population should be carefully thought-out and 
answered e'arly rrr^e planning -stages^ / * 



EX^CISE 3.2\ Target Population; 



What is the target population of 4 your sample survey? 

0 ^ 

. : , > — , 





y 
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IV: TYPES OF SAMPLING PROCEDURES 



Underlying the well-run sample survey is the concept of the^ 
sample. A sample is that portion of the target, population which 
has been s£lectecl to represent the target population. Sampling 
is the operational procedure used to select that sample. This 
section, will introduce several forms of random and nonrandom 
selection procedures. a 

• \ 

n • * * * • « 

Sandom sampling is a procedure in whicfc all subjects have an 
equal chance of being selected. ' In nonrandom sampling, subjects • 
are not selected by chance; they dp not all have an -equal proba*- 
bility of being chosen. The last section deals in part with sampl 
size; i.e., how many subjects should be* contacted in ord^r,. to h^ve 
a reasonably good-size sample — one that allows generalizations 
to be made about the target population with a certain level of 
confidence. .One 't^ng th&r should' be kept in mind is that a 
sampling procedure %*never good or bad in its^Lf — it must be 
evaluated *by £ts, ability to. satisfy the objectives o* the survey. 



A. Nonranflora Sampling Procedures „ * ; 

» * 

1. Haphazard Collections 

This sampling procedure relies orr subjects, Informally met 
or readily available, such as shoppers in a ^ft^gging cfentpr or 
students in a -classroom. TKjUs procedure does not^llow the 
survey designer to generalize beyoijd the people interviewed but 
is frequently used when time or money is limited.^ 4 

2. Judgment Sampling * / . / 



• ' ,With this procedure, the subjects chosen by the interviewers* 
are those felt to be most representative of the target population. 
A major limitation of this sampling -procedure is that interviewers 
may have' different ideas about who would/ be a typical representa- 
tive. • 
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3. Quota Sampling •• 

Us^ng this procedure, subjects are selected for the sample , 
'according to their proportion in the target population. If the 
target population contains 25 percent Catholics, the total number . 
of Ca'thol-i-cs included in the survey will ideally also equal 25 
percent'.' The selection of delegates at the 1972 Democratic 
convention is an example of "an attempt at quota, sampling using the 
entire country as a target population. As with judgment sampling, 
the weakest aspect of this technique is the determination of the 
individuals to -be included in the quota. Different interviewers ^ 
may hbld different views as to who should be_ contacted, yfhich would, 
add an unknown amount of 'bias to the' resu-lts". * 

4. , Expert Sampling \ v • 

— . i 

This type of sampling relies on the opinion of experts as to . 
^ich subjects are representative of the target , population and 
should be included in the survey. The major limitation of this 
method rs that .experts iriay differ on those subjects to be- contacted. 
This technique can provide interesting'case histories; but it'rs « 
not a dependable" source of information for making generalizations 
on the target population* • 

5., Purp.osive Samples 

This method selects subjects from certain subgroups in the 
target population: ^ The subgroups are chosen because of their • 
bearing on the hypothesis to be tested. Purposive sampling can 
be of some vajue if random sampling is use'd at each* stage in the 
survey design/ , , . 



B. Random Sampling , ' ' 

' The following sampling procedures rely to a greater or lesser 
degree on random chance to define which subjects will be "contacted. 
For statistical reasons which are beyond the scope of this chapter, 
sampling procedure^ut ilizing random chance for 'subject selection 
provide the best estimates or ' generalizations about the target- 



population • 



1. Simple Random Sampling 

'This method chooses each subject through a random process in 
which each unselecte^ subj-ect has the same chance of being chosen 
as any other subject on each draw. The selection of a particular 
subject could be made on the basis 'of flipping a boin, tossing a 
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pair of dice, or most commonly, with some type of random-numbers 
generator, usually a random-numbers table or a- computer program. 
Each subject is given a 'number, and wherf that number^ comes up on 
the dice or is found in the random-numbers. table; the subject 
is included # in £he survey./ This prqcess continues until a 1 
sufficient number of sub jects has. been selected. Generally, once 
a subjec|f^has been chosen,, that subject is not eligible to be 
selected a second time. 



• Simple random sampling may not be feasible for a nufibpr of 
reasons. .For; example, it may not be economically or physically • 
possible to contact people, all Qver the city or.* county for a 
survey involving a medical procedure suph as a .chest 2i-ray with 

its complex attendant equipment. ^ Also, ( ^ current and complete list 
of the subjects in -a target, population* may ndt be a"v£tilable. For 
these and other reasons researchers -have^ developed successful 
* variations qn^ Simple random, sampling vjhich are'>ast*ly ^better than, 
nonr&ixclerffi procedures** . * \, ~ * * * • • 

" 2. \ Stygt/ficatloff Sampling ' % * v 

• »This Is a method that splits the target^ population, .into sub- 
groups. *Once the subgroups- have, been determined, the same 'or 3 - » 
different selection procedures can be used, on* each of the* subgroups 

„ For example,' suppose thq researcher wanted to conduct. a survey , 
using 20CT subj.ects.'. The target population- might be working men arid 
women containing 60 *pei^cent--ttnion members and 40 'percent nonunion 

'members.* U^jtag "this method* the researcher Would conduct 120 inter 
views 'with the subjects, randomly. Chosen among ;the union -members , 
and 80 interviews/ again with, the Subjects randomly chosen among 
the nonunion members. ' * * 

, 3^ Cluster Sampling , \ % 

-'As the name implies, cluster sampling involves choosing the 
subjects to be interviewed in'cluster^ or groups, rather thari 

, singly as done 'in simple ran-dom sampling. Usually, the clusters 
are .naturally occurring groups within the target population for « 
example, the banl^s,, hospitals'-, ' or ' voter pfecincita in a* community. 
A random selection is made of these natural clusters and* within 
each cluster either all the subjects can be interviewed or a 
random sarpple 'of the sub jects . can t>e contacted^ This procedure # 
will most likely produce results, that t are slightly less accurate * 

I than thos^ from a single 'random .sample. \That may be a small price 
to*pay, however, compar.ed*to the increased convenience and, reduced 
costs of a cluster sample as opposed'to aasiraple. random sample. 

4. v . Systematic Selection .Sample . t , 

< . This third variation on sample random samplingTinvolves 
choosing the subjects from a list of the members ^of the target* 
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•population, The researcher should be certain, that the people are 
not lifted in any symptomatic .fashion such as grade point average 
or income level, which would introduce an unknown bias into the 
results. Following a random start; every nth subject on the list 
is included in the sample. For example, let us suppose that the . 
list of the target population contains 1000 members and the 
researcher plans to interview every 10th member-. He or -she would, 
look-up the starting point in a table of, random numbers.' If that 
number were 37, then the subjects contacted, would .be 'numbers 37, 
4*7, 57, and. so on, until the end of the list was -reached. .' t 



C. Conclusions 



•There are two basic types of sampling procedures: "random 
and nonrandom.' The nonrandom procedures include haphazard .collec- 
tions, judgment sampling; 'quota sampling,, export sampling, - and 
purposive sampling. While nonrandom ^samp'les' ar# valuable , in 
certain instances, they do not allow one to make statements about 
■ the target population with as much confidence as do random 
sampling, stratification sampling, cluster sampling, and .systematic 
selection sampling. .Random sampling gives -the ; .most accurate esti- 
mation of the true values of the factors being studied in the- 
target population . ' , • . - . 

EXERCISE 3.3: Sampling .Procedures ' - ' ' 

^ Give T detailed account of how your sample will be drawn.** 
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INFORMATION-GATHERINQ TECHNIQUES AND TYPES, OF RESPONSES 



/There ^re fou'r major methods used to 'gather information — 
m the face-to-face interview, the telephone interview, the mail 
* questionnaire ,' and the self-administered questionnaire, given in 

-*a group setting such a§ a^eltlb meeting or a classroom. Before 
. writing the questions, the r.esearcher npst decide which of these 

methods will be used\ 



A. In£ormation-gatherin{r Techniques 

There are some important advantages in having information , 
collected by an interviewer, whether ' face-to-face or over the 
telephone. First, the interviewer can stimulate the subject's 
initial interest, whi.ch, 'in turn, increases the probability that 
the person'will take'part i-n the survey. Second, by creating a 
supportive atmosphere for answering the questions, the interviewer 
may increase the subject f s motivation to respond, iri a thorough 
and straightforward^ fashion.- ^ Third, the interviewer has more 
flexibility in asking questions and can clear up any ambiguities 
in the. subject f s response. (Wi'th a .self-administered' question- 
naire, the subject may skip^those questions not fully understood, 
thereby reducing the accuracy of the survey.) . Fourth', using an 
interviewer to administer the questionnaire reduces the probTem • 
which might occur with a self-administered questionnaire due to» 
the literacy /educational level , or visual acuity* o'f the subjects. 
Finally, the interviewer ^can^contrQl the sequence in which qugs- " . 
tions are asked which migfrt be important 'when later questions 
affect those that come before. ' • 

„"* . * Th( s very advantages inherent iff' .the personal .interview can . 1 
be turned into' disadvantages when compared tc* the self-admini'stered 
questionnaire. The greatest /advantage of the' self.-admin : iste^ed , . 
questionnaire is m its relatively 'low cost and ease o.f .adtainistrat ion 
In contrast to the face-to-face interview and" the , telephoije^ survey-. 
An* interviewer must 'fre paid a salary, and travel anfc other experts es 
involved with being out in tly£ field. He mighty, moreover , get ' 
bored with the Purvey , become ill,' leave town, or find aiiotffcsjr job, 



creating the perennial problem of interviewer turnover. / Or, 
personal interviewers themselves may^ be biased in one d,irecti9n , 
or another so that presentation of the questionnaire. 'may differ. 
Finally, a selvf-ariministered questionnaire, may be advantageous 
when' dealing with ver^ pl*sonal .or ' embarrassing issues* The 
subject may feel more comf ortgtble about answering certain questions 
on paper, father than responding to a stranger. 

Telephone Interviews \ 

> ' > 

This method has many of the strengths of a f ace-to-f ace inter- 1 
view, and is substantially cheaper to conduct'. In addition, sub- 
jects suspicious, of a person on their doorstep might be willing to 
talk to the same person over the telephone. However, the telephone 
survey also su'ffers from serious l,imitat ions , among which is the - 
difficulty of estabiisliing and maintaining the level of rapgprt 
that* can be develQped with a face-to-face interview. The second 
problem is that the subject can terminate - the interview by simply 
hanging up the phope. Thus, the questionnaire usted in a telephone 
survey jnust'be short* and easy to\ansWer. * 

/ . * • A ■ 

• ° > \ 

Mail Questionnaires, > , 

The majoV advantage of mail surveys is their relatively low - 
cost, while their major limitation is their low response rate. 
There &re- three- factors which "should £e kept in mind wtren develop- , 
ing t a mail survey. First, the more work a subject is "required* to 
perform,^ such as. answering a long questionnaire or searching for 
a stamp, the lower the response rate/ Second, a personally /typed t 
covering lefter or the use k of firs't-class mail very likely will 
increase the response rate.- 'Third, the greater the subject's 
-interest in the outcome of % the survey (for example, a survey within 
°& Company concerning salary increases), the^higher the response 
rate will be. ' ' > 



B. Open-ended and Closed Responses '« 

* • * x + * 

, * \^ ** • 

.After determining the method bf gathering .inf ormatior) , the 
researcher must, decide' it 'the survey will contain questions that 
are otfen-ended* resporfse*, closed response, or some combination of 
the two. \ 
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1. Open-ended Respohses - , " * . 

• Open-ended response questions are those- that allow subjects 

• to ai^wef th£t quest;Lpn in whichever manner* they see fit without* 

/• ^restrictions imposed by the questionnaire's designer. An ejcagmple « 
0 jd this typfe of. question is: f! There has-been a great deal-of, 
concern aBout the rising cost of food. *How do you handle the 4 

\ problem' of rising food c6sts? u 

* The most important advantage *of the open-ended response - 
question is that* the respondents* can . answer using their own reason- 
ing and thinking patterns. These answers will often be filled' 

* with quotable material to lendcplor .to the final report. In , * 
addition', such .questions may provide a useful -source of information 
from* which \o generate hypoiheseS. Another advantage is that 
opgn-ended responses do not produce answers where none exist , which 

'* may be a problem with clpsed-respon,s6^ quest ions . Finally, this 
type bf question can provide a chance for subjects to "warm up" 
at the beginning of the interview. The -major limitation to this 
.type of response question lies in, the : di*f f iculty o| 4igefcting and 
making sense out. of t'he answers given. The range of answers may be 

* so varied that it wpjyjd b$ difficult to make meaningful comparisons 
between subjects. " Anptber problem is ihat interviewers will be ■ 
various]^ skilled in ^recording verbatim responses which, in turn, 
will bias* the 'results *of the survey; 



2. Closed Responses 

As the name implies, this type of question limits .the kinds* 
of answers the subject gives , t requiring a choice of one or rfu3re 
of tl;e answers provided by 'the questionnaire. The fallowing is 
an example of closed-response question^* ' * ' ' , 

S - 0 . ' 

• There has been a great deal of concern about the, rising 
cost of fo9d\ How do you handle the problem of rising ' ' 
food -costs? ■ (Check all that apply^ ) * : 

v ^ . _ • 

s purchase cheaper types of #j foods * , 1 

4, substitute other types* of^ 'food in your 1 daily diet 

. . purchase large amounts of an item which is* on/sale 

* , eat at restaurants less often ' .' % V 

• ' _ ^invite fewer people over to eat a meal ajt your home 

" 1 don't know * . * • 

. ■ % • ' ' * . % ■ 

, The major advantage of closed-response questions, is .'that the' 
answers given by the subjects' are "comparable and-Aimited in number." 
This, in turn, makes coding and an-alyzing' the data/^much easier. 
In addition, tjiis type of question requires 'less Skill and' effort*' 
on the part of the interviewer, and is easier for/Ltfife subject to 
lanswer. The* most serious 'drawback is that the closed-response 
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•question' may put. words in the subject's mouth by .supplying' answers 
.he may not have thought of by .himself. Most subjects do' not want 
-to admit that they ' have ncJJ heard of an issue and they can conceal 
this fact by choosing one of the answers; provided. They may also 
be inclined to 'select a, "don'"t know" response, thus avoiding the 
time and' energy required to think about the question. 

EXERCISE 3.4: Information-gathering Techniques ^ 

'What method will you use to gather information? Describe 
* any problems or limitations of the technique. ' • 



EXERCIS^ 6,5: ^Type of - Response 



Will you use open or ^closed responses?- Why? Give a sample 



survey 
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C. Bias in the Sample Survey ^ „ 

* * t 

A survey is rarely as nqat and concise as one woul % d like. Its , 
design and application are* not influenced solely by the scientific 
method* The* survey is a product of people operating in the- area 
of the real world and therefore is susceptijple to* the .influences 
of many actors. Bias i£ any type of systematic error* in the data' ' 
collected by a s'ampl£ survey leading to a. difference between the 
sample value and the true population value. The problem of bias 
is constant in a sample survey. A possible source of^bias is the^ 
agency or group supporting the survey. It may have a vested 
interest in seeing that the results of the survey are in accordance 
witji it*s own position on, an issue, since a great (leal of money^r 
political influence may be riding on the outcome of\the survey.* 
The'funding agency may. want to decide which problenris of interest 
and* designate the type of relevant information collected to the 9 . 
exclusion .of other kinds- of information. While it is natural, that 
the sponsoring agency assist in formulating the sample sujvey^ , 
objectives, the researcher should be aware of the potential biases 
of the agen&y and strive to minimize their impact. The day-to-day \ 
working relationship between the researcher and the sponsoring 
agency will influence all aspects of the sample survey^ That" influ- 
ence* may introduce biases not only in the formulation of the prob- 
lems to be studied, but also in the hypotheses "to be tested,, the 
selection of the respondents, the wtfrding of the questions, the . 
analysis of the information collected, the explanation of the final, 
outcome, and the utilization of the* results. While it is not being, 
suggested that every agency is, trying to blatantly pressure the , 
researcher to produce favorable results, the researcher should 
always make an effort to reduce potential bias regardless of the - 
source. . 

Another source of bias lies in the answers given by the 
respondents who may 1 report the answers they ^believe the researcher 
wants to hear, rather than their true opinions. The respondent 
* may give only socially desiirable answers,- i.e., thos^p which put him 
in compliance with society 1 s 'mores ^nd values'. J 

Minimizing Bias • 

At the very least, the researcher should employ intellectual, 
honesty and openness as the first, step against biasVin sample 
surveys * In addition, several other precautions can^be taken to 
counteract bias. At e*kch stage, the research design ^should be 
reviewed by ,a range of interested parties. These reviewers could 
indicate, for example, whether they thought the survey was preju- 
diced toward some group or whether the initial description of the 
results contained 'ideological overtones. If opposing groups agr^e 
that the survey is impartial and will generate objective data-, the 

)• » - 
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researches can be fairly- .certain ..that 'the survey will -not suffer- 1 
ideological bias. • ■ t : 

# A second' precaution is to seek outside expert opinion about / 
the apprSfcriateness-of the sample design. An expert can. deter- 
mine i£ the instructions for deciding who will be contacted to 
answer the survey follow the laws of probability sampling. -j 

^-Finally, the questionnaire to be used in the survey should ^ < 
be reviewed by. a panel of -experts to determine the objectivity \ 
of the items being used. Leaders of the" interested groups could \ 
also criticize the quest ionnai<re. items for potential sources of 
bias. , ' • " * 

EXERCISE 3.6:" ?ias and (ft lie r Problems * 

c * * 

Do 'you foresee any bias in your sample survey? If so, from 
where? Do you foresee any other ' problems such as excessive* cost 
or , nonresponse?. Please* qxplain . * 



r . . 
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CHAPTER FOUR: DESCRIPTIVE ; °STATISTICS FOR PUBLIC POLICY ANALYSIS 



■ \ 



THE PRIMARY OBJECTIVE: 



To introdtnSe you to basic statistical skills used in the 
analysis* of public policy issues. 



UPON COMPLETION OF THIS CHAPTER; YOU WILL BE ABLE TO: ' \ 

..> * ■ •> t • 

* Arrange small -djfita- sets into 'tabular form. 

* Organize large data sets into frequency distributions^^ 
„ * Construct- and interpret graphic -displays *of data<^ 

* Calculate and distinguish among several b£sic statistics. 

* Perform data analysis and interpretation using these • 
statistics ^ 



(Based on PS-20: Descriptive Statistics for Publ-ic Policy Analysis .. 
G^ry Hammerstrom and Amy M. Kafton, Ci^jton^on-Hudson , NY: Policy . 
Studies Associates, 1979.) . 



■* * * . 

I: PRESENTATION. OF STATISTICAL DATA * 



Objectives 



. To arrange dat'a. sets into tabular form expressed in 
units relevant to your aujiientfe'. 

• • , : / : ■ * 

* To }y SLTn the . importance of proper data documentation, 

".^To learn the 'appropriate statistics for data scaled 
* at different levels ;6f measurement v 



A.* Tabular Methods. 



is 




Data ' are' often- psesenfed in 'a; textual form that is both \ . 
uninteresting and u"nenl£gtitening. " -For example:. • „ * • 

' ' ft ' ' ' ' s *' 

- According 'to"" the? National Safety Council, motor , * • 

vehicle travel in the Urfited Stkt.es has increased 

from 420' bullion-miles in- 1950, to^OO bilMon miles- 

' '.in 1955,* 720 billion .m'iles in 1960, -900 billion miles 

• in*1965,-kand 1100 billion .miles in 1970.* . ? ^ ♦ • 

" However,- the same data are much easier to read if arranged in 
j tabular f orm^ such a,s in" Table .4.1. ■ • r , 

• \ * i ' * ' * 

' From this table, it is easy > to see the dramatic change'in * ' 
"the Variable* (a" characteristic'whicH- may take on different values) . 
* over the time series" (the pattern of miseries of values arranged ^ 
in a time sequence)., : ■ , ■ 

^ ■< ■ . • \ 

Tabular methods are a widely accepted means of organizing smaM* 
sets of data- for rapid visualization and understanding^ /A table 
requires: .y %. n * * ..' • 

. A title which clearly explains its' nature. " . * ; X 

' .' Data elements carefully listed-under headings which • 
clearly specif y. the units of measure. 

•i Documentation of the data source. . • 

. , ' • 108 ' . 
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TABLESl^l : 


t * 

Motor' Vehicle, Travel, in *the U.S. . 

'<•/•••' •. . 1 


» 

* 






> 








* 

^= 


Year 


_ yehj.de Travel < 
(billions of jnllea) 


f 




> 

• 


. 1950 ' 

1955' 
- - - I960 

1 ' 1965 
1970 


, 420 * 
, A 600 
' ' ?20 . 

900 - 
1,100 


* 

\ 



Sources' Accident Pacta . Chicago* National Safety Council 9 
197^9 22. ■ y/ 



c 



In presenting statisticsH^data, the researcher must consider 
the relevance of units of measure to /the audience which will be 
using the data. Examine Tattle 4.2. Although this table shoes' 
the growth in Japan's economy, t'he total magnitude. of the economy 
is not evident to American readers. Do you Know 9 the exchange rate 
between U.S. dollars and Japanese yen?' Most people reading 
Table 4.2 will, not "know either. Thus, \X> ,is important to express 
this data in v terms that are most 'easily understood* byTthe intended 
audience.. Table 4.3 presents the same information, but converted 
to UrS. dollars. 



Table 4.3 makes more sense to an audience which has a better 
perception of the value of the dollar than it ..does of the yen. But^ 
we are still dealing with .very large quantities. How impressive ^ 
w> is a gross national' product "of $294.1 billion? 6 Mosf social 
' § scientists, including students, probably h^ve an idea of the current 
U.S. gross national product, but few can remember what it was 10 or ' 
20 years ago. Thus, to give a more complete description of the 
size and expansion of Japftn's gross national product, data should 
be expressed, in U.S. dollars and a comparison made with U.S. gross 
national product data as in Table 4.4. 




In choosing units of measure it is thus important to consider 
magnitude t of the measurement. What may be a totally under- 
ndable unit at one level of magnitude may be difficult to grasp 
at another. For example, most everyone can. visualize the approxi- 
mate size of 1 square mile. Yet, should you report that 6200 square 
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TABLE 4.2: 

* 


Gross National Produot o'f 'Japan, 
1950-1970 in Five-Year Intervals 


' * * 




' 'Year 


» 


- f G.N. P. 
(billions of yen) 




.1950 
1955 
I960 

, ' 1965 
. 1970 




* 

11.310.3., • 
' 17.576.1 
„ 27.266.9 a 
^258.9 • 
78.083.5 


Hourcei 
% 


1976* World Book Atlas, Washington. D.C.i The World 
Book, 1976, p. 16. * § . 











^ 



TABLE 4.3: Gross National Product of Japan, » y 
1950.-1970 in Five-Year Intervals 





* 

■ ■-■ < 


Year 


G.N. P. 
(billionsT of dollars) 



>. 1950 . $ 42.6 

; 1^55 • 66.2 

I960 *" • * 102.7 

1965 • , 166.7 '. 

1970 . 29^.1 

Source 1 1976 World Book Atlas . Washington, D.C.i The World 

Book, 1976, p. 16. < r- 



/ 
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* TABLE 4.4: Gross National Product -©1 Japan and the 

U.S.; 1950-1970 in Elve-Year Intervals 



G.N.P. JAPAN G.N.P. U.S. 

Year (bllllona of dollars) 

1950 * ^2.6 , * 519.1 

1955 66.2 . • 639.9 

I960 v 102.7 712.5 

1965 . 166.7 902.6 

1970 29^.1 1,055.6. 



Sourcei 1976 World Book Atlas . Washington, D.C.t The World 
Book, 1976,' pp. 16, 20. 



miles of the U.S. have been; stripmined since 1945, you might have* 
trouble communicating a pe'rcep^ion of area to your readers. Were 
you. to add a meaningful size comparison, such as that 6,2t)0 square 
miles is approximately the size of Massachusetts, Connecticut-, "and 
Rhode Island combined, then the statistic would ,be much easier to 
» comprehend . 

• # 

Thus, in c6nsidering units - of measure,, kepp the following 
points in mind: 

.< The* units of measure should be relevant to or commonly 
understood by your target audience. 

The magnitude of measurement - should be easily compre- 
hensible to your target audience. ' If in doubt, pro- 
vide some basis for comparison. 



B. Data Documentation 



it)o 



To document dataisimply means to cite the source from which 
the data were obtainea or derived. Data sources can be cited by 
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using standard footnoting and bibliographic techniques, wJLth. the 
footnotes placed at 'the bottom of the appropriate page or collected' 
at the bacic of the ,work. With data displays such as graphs or - 
'tables *( such as Tables 4.1 'and 4.2), you should include the data 
' citation, in the display. • - / ' . . 

However presented, the citation should conform to standard 
literary style guides. When, using data*which is not your own, be 
as careful as possible that it is accurate and then cite it com- 
pletely; \you must provide adequate information so as to allow the 
.readers the opportunity to consult the original sources erf data if 
they desire further information. # 

^Proper data documentation is not only a matter of honesty (to 
knowingly omit, credit is plagerism), but also a matter of scholarly 
expedience. If data which you have used and cited are later found 
to be in error, you will not have to bear the responsibility for 
those errors, and although your conclusions may consequent ly~i>e 
invalid, it will be for reasons beyond your control*, 



C ♦ Levels of Measurement 

■ ' ~F " 

A knowledge of the type of measurement and scale used in 
developing data is quite important to th<? selection apd interpre- 
tation of stwKstics.^ Certain statistics are usable only with 
fspecific appropriate scales . m There are four major types of 
scales of measurement, classified in terms of their mathematical 
properties. , * « 

r. 

1. Nominal Scales . * ^ 

This type of measurement deals with qualitative variables and 
categorization. Qualitative^ variables differ 'in kind rather than 
amount. You can say whether observations are the same or differ- 
ent, but not whether one has more or less of the quality in ques- 
tion. For example, Republican and Democrat are two categories of 
political affiliation. They are different, but a Democrat does not 
represent any more of the variable "political affiliation" than a 
Republican. Nominal scales -do, not rank qualitative categories; 
they simply record the frequency of occurrences in each category, 
*tnd speak in terms of similarities or differences. Categories may 
be designated by numbers, but these jnerely serve as labels or sub- 
stitutes for nairtes. For example, airlines use numbers to identify 
their ^flights, but that does not mean, say, that traveling on* 
flights #100 and #300 will get you to the same location as taking 
flight #400. Similarly, we do not expect football player number 14 
to-play twice' as well (or necessarily better ball)' than player 
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number 7. .Flight' schedules and football ^rosters* are both ^nominal 
scales'. 

* 2. Ordinal Scales 

In this -system of measurement, qualitative variables are used 
also, but they are ordered by ranking. Not only do we note" whether 
A is different from B, But whether A is greater than or >les^ than 
B. This is a measure of differences in position between elements 
along some specified continuum, but. with no indication of the 
magnitude of the differences. For example, the order of finish 
in a beauty contest is an ordinal scale — although the. judges 
decide that on*e contestant is prettier thai} another, we cannot 
assume <that the second runner-up is twice as pretty as the fourth 
runner-up. , * 

Other examples of ordinal scales include social class (upper, 
'middle, lower),- rank ordering of political candidates ^according to 
^heir popularity in the polls, and rank prdering of occupation's 
ccording to theii* prestige. The ordinal scale also serves the 
functions of th^ nominal scale by "identifying equality and 
inequality. (E^cfr subsequent scale in our discussion will include 
all of the functions of $he lower-level scales plus new functions 
and levels of sophistication . ) 

3. Interval Scales 

Interval scales represent quantitative variables which indi- . 
cate the amount of a characteristic something has. Addition and 
subtraction can be performed on quantitative variables. Some » . 
standard physical unit of measurement is necessary -for interval- ( 
level scaling so that the distance or interval between any two \ 
elements in the scale is the same as the distance between any other 
two elements. Therefore, the difference between 4 feet and 2 feet 
is the same as the distance between 501 and 499 feet. Temperature, 
as recorded in degrees Fahrenheit or Celsius (centigrade), is of 
interval-level measurement. A' temperature rise f-rom 20° to 30° 
is equivalent to a rise from 80° to 90° in that both changes 
increase the temperature by 10°. 

An additional feature of interval scales is that they do not 
contain. an absolute zero. They may have a zero value which has y 
been arbitrarily assigned, but their absolute ze.ro point is elthejr ' 
upknown or meaningless For m example', temperature sc^le^meitsur^/ 
the amount of heat present. Yet, the zero point on either tfte 
Fahrenheit or Celsius scale does not identify the absence of heat. 
Thus, in terms of the -amount of heat present, 100°F is not twice 
as warm as 50°F or ten times as warm as 10°F. Also, the year 2000 
ArD. does not mean twice as old as 1000 AlD. since the world was 
not created at the arbitrary 0 A.D. Interval scales do not provide 
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information about the equality of ratios between points -on the 
scale* which cannot be done without the existence pt an absolute, 
zero. >.••<■ 

Note that quantitative variables are continuous — they are 
theoretically infinitely divisible; i.e., between any two.numbers 
'■thdre can be another. An infant growing from a bright of inches 
to a height <*f a few fefet passes through an infi'ni^e- .number of . 
heights. In .contrast, a discrete variable can have only certain 
values and none in between. For example, the number of people . 
who took an exam might be 35 or 36, but no value between these two 
figures is possible. ' A constant is a characteristic wh^ch can 
only have one value — the number of days in a week is a constant. 

' 4. Rat io- Scales 

1 1 ii — « 

Quantitative variables associated with ratio scales can be* 
• added," subtracted, multiplied, and .divided. This is possible 
because such scales have an absolute zerp point which indicates . 
the absence of the variable in question and allows for an evalua- 
tion of ratios between intervals. Ratio scales include height, 
weight, speed', population, distanQe, the number of votes a candi- 
date receives, and the amount of money allocated to a budget. 
Temperature can also be measured on a ratio scale called the Kelvin 
scale, which has an absolute zero indicating the complete absence . 
of heat.. That point" has been determined as equal to -459. 4°F or 
-273°C. * : Although the absolute zero point is known for the , 
Fahrenheit and 'Celsius scales, they are nevertheless interval 
scales because their zero point has been arbitrarily placed else- 
where . t Only on the Kelvin scale can we say that 400° is twice as 
W.arm as 200°. * 

0-- 

Apart from the difference in the nature of the zero point, 
interval and ratio scales have the same properties and will be /\ / 
treated alike throughout this package. ' 

'We have identified f6ur types of scales and measurements and 
four important scale properties. Table 4.5 summarizes that infor- 
mation. * _ • • • 

As statistical techniques yare introduced, we will indicate 
which^are most appropriate foVdata scaled at different levels 
of 'measurement . ...» 
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.- TABLE 4.5: Properties of Measurement Scales 



















. ^ 




Scale 


Identity 
and Equality 


Oi^der 


Equality of 
Interval 


Equality 
-of Ratib 


Nominal 


Yes 




* 




Ordinal 

> 


Yes 


. Yes 






Interval 


Yes 


Yes 


'* Yes 




Ratio 

> 


Yes 


v Yes 


Yes 


Yes 1 


EXERCISE 


4 

4.1: Tabular 


Methods 


1 

* * 


6 



Choose an article from the New York Times which concerns 
a public policy issue. Using* at least one real statistic (the 
rest can be hypothetical), construct a table. Be sure to properly 
label the table and to note the source of the information. ,Make 
a riieaningful interpretation by using the ^able to support a point 
about the public* policy issue. 

r • ■ •• ? 
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II: 'GRAPHIC METHODS OF DATA DISPLAY 



Objectives 



To learn basic graphing skills. 

To construct a variety of graphs appropriate to both 
direct data tabulations . and frequency distributions. 

To^interpret a variety of graphic forms according to 
the nature of the variable relationship presented. 



A. Basic Graphing Skills * 

^-j , A graph is .a pictorial representation of data constructed for 
' the purpose of studying changes variables 5 or for comparing 

several similar or related, variables. The construction £nd inter- 
pretation of a well-drawn graph are not difficult. A graph shows a 
'series of points, each of which defines values to be read on two 
different scales. These scales express the* range of two variables. 
. The Joriz'ontal scale. *is called the Abscissa or x-axis, while the 
. 'vertical scale is called the ordinate, or y-axis. Generally, data 
" such>as scores, .time, nominal categories, and variables that cause 
clj^nge in other variables are plotted -on the x-axis. 

'To illustrative will present -ttife data in Table 4.6 in a graphic 

form. . 4 * . ft 

' * • ♦ 

'We wish to show .on the graph that in 1950 the auto insurance 
premium rate was $69.63. This is represented by a point on the 
graph defined by the. intersection of a line drawn vertically from 
.the value "1050" on the time scale, and ^line drawn horizontally, 
from the approximate value "$69.63" on. th>e premium scafle. 

The dotted lines «on f the graph represent mental reference* lines 
which would not normally be shown. The remaining >p^irs of. values 
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can be plotted in- a similar fashion to yield a graph of five points, 
which can then be connected as in Figure 4.1 to ftfrm a broken \irte 
graph. • 4 - ^ \ * , 
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TABLE 4.6^: New York State Automobile* 

* \Irisurance Premium Rates, 1950-1970 









* 






! Year' 


- Premium Rate 





■195P 

1955 
I960 

1965, 
1970 



% 69.63 
86.98 
IO8.67 
U2.87 
135.6'0 



Sourcei "Trends In Insurance Premiums," New Xorkt New 
» Insurance Council, 1972, p. 87. 



ir York 



State 



Figure 4.1: Basic Graphic Format 



y-axis 



$75 

($69.63) 




1950 



x-axis 



1955 



'Auto Insuranoe Premiums In N.X. State 
Sourcei "Trend* In Insuranoe Premiums," New Xorkt 
New Xork Stmts Insurance Council, 1,972, p» 
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When const ructang a graph, re.mera^er^^ 



. . ' A graph should always hav^^ti ^explanatory title.' * 
fc Axes should be labeled. , '*STf > f ' ^ * 
. ^ Scales must be calibrated accSr^ately^*- - - 

* - . V the- source of the data must 'i5& crt^d. ■ 

* <• <* . - 

' It is a good idea to .start the* y-axis at' 0 and, although the size 
of. scale units is' optional {e.g., 0, -5>. 10 or QT 9 } 10 t * 20, etc.), 
consistency 'is important. The "three-quarter 1 high, rule , agr$|d . 
upon by 'many statasticians for graphic di«spl^ys 3 ; pf frequency dis- 
tributions, st&6!te that the y-axis- should ^ about >three-quarters 
of tAp length of tfie x-axis. Adherence io thfe&eL convent ions can 
help avoid biasing ot the* data presentation.- t v 



# B*. Types of Graphs 



1. Bar Graphs 



\ 



The bar graph makjes data "compaf isons'^by th,e use df parallel 
bars placed qither yertically or horizontally ori the graph. Fig- 
ure 4.2 is. ah example of a vertical bar graph* * 




Figure 4.2: Vertical Bar 'Graph V- 




■£■<$ 



\ 

\ 

■ A 



1900 1930 1960 1974 19^0 2000 
Ytar '* 



J 



\ 



Percent of U.S. Population Age 60+ ^ 

Source i U.S. Congress, Senate Special Committee , - 

on Aging. "Nursing Home Care. In -the U.S. , 197^. 
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*\In the construction of a bar graph, tTie length of the" bars 
and the space between\them should be consistent and also allow 
for-clear visualization. Bar graphs are useful -for representing 
frequencies or levels of observation in different categories of 
nominal data, ordinal data, -apd interval dg.ta grouped in frequency 
categories* . 

* 

By lengthening- or shortening axes, exaggerations or minimiza- 
tions of differences are possible. Figure 4.3A emphasizes the 
differences in tar content for three brands of cigarettes. Figure 
4.3B uses the same information and gives a different impression by 
stretching out the x-axis ^nd using different units on the. y-axis. 



Figure 4.3:- Bar Graph Variations 
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2. Tr end Line , ... 

— - — • « 

A trend line graph is what;. most people visualize when they hear 
-the term "graph." The trend Mn'e is derived by plot/ting t'ime, in 
years, 'mdnths,' or days 0 on the x-axis, and something' which • is chang- 
ing over tiifie on the y-axis. . This type of graph shows the progress 
of that Which is on the y-axis over time. The trend can alfso be 
"projected into th&- future. This type of display is useful in , 
jnonit^ring and forecasting. .Figure 4,4 is an example of a^t^nd 
* line. * * ' * • 



Figure 4.4:. Trend Line 
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3. . Pie Diagram 

The last graphic technique 11 to be described is the pie diagram 
which is used to show how the component parts of a sum are divided. 
The apportionment of government spending or the ethnic composition 
of a political party are both, examples of subjects amenable ttf this 

- ' 120 ^» 
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^technique. A pie diagram is not difficult to construct if you , 
rem%iaber that the total ^of 100% is described by a circle of 360°. 
Thus, each percentage is equal to* an arc of 3.6*. To illustrate, 
we will construct a pie diagram %o show the distribution of people 
over 60 years of age by age group. The raw data are contained in J 
Table' 4.7. > ' . 



TABLE. 4. 7: Age Distribution of Population Over 6X) in 1974 



Age Group 

60-6^ years 
65 - 7^ years 
75 - 8^ years 
85 years and over 



Percent 

* 29.7* 

1*3.6 

21.1 

5.6^ 
100. 



Source: 



U.S. Congress, Senate Special Committee' on Aging, 
Nursing Home Care jn the U.S. , Washington, D.C. i 
Superintendent of /Documents , 197^. ' 4 



If each percent figur-e in Table 4.7 is' multiplied by 3.6°., we 
will know the size of . the arc that must be drawn for each segment 
of the pie. 



29.7 x 3.6 
1*3.6 x 3.6 
21.1 x 3*6 
5.6 x 3.6 



106.92^ 
156.96° 
75.96° 
20.16° 
360.00 J 



ERIC 



A. protractor should be used to measure the necessary angles 
on the circle.' .It is a good idea to plan ahead so that you ha"te 
your narrowest angles at the sides where they will be the easiest 
to label. Jhe labels canHeither go inside or outside the circle 
(the latter treatment jgs preferable w.f there are especially narrow 
angles). . 1 
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As illustrated in Figure 4.5, the pie diagram -can be a very 
effective technique for the* visual display of data. However some 
caution should be observed. (Pie diagrams containing ~lto?re than 
♦eiglA segments, or containing several segments with very small arcs 
(less than 5°), are difficult to label £nd oft,en appear so' clutt^r^ 
as to be difficult to interpret. A pie diagram (or any graph) which 
is difficult to interpret or confusing' is of no -assistance in^analyz 
ing data* or in presenting the results of analysis. • * , 



Figure 4/5: Pie 'Di'a grant 
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EXERCISE 4.2: Bar Qraphs, Trend Lines, and Pie Charts 



^Using a/^ecent New York Times 9 ayticle on a public policy issue, 
construct a bar graph, a trend line, and a pi'e chart • 'At least one 
^statistic in each display must be real^ make fc. meaningful inter- 
pretation by using each display to fftake; a pQifit about the public 



policy is-sue(s). 
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•III: MEAN AND STANDARD DEVIATION 



Objectives > ' 

^ . To calculate the mean of a da£& set. 

To caldul'ate the standard deviation of a data s.et • 

• * 
So far in tlais chapter, ,we have been primarily concerned with 
the organization of data. * Now we will learn to express our results 
more efficiently. Measures of central tendency are single, quanti- 
tative values * e which describe an entire distribution in terms of 
some central location of data ^elements such as the average person, 
score, salary, and number of children.* The. most common measure / % 
of central tendency is the mean. 



A. The Mean 



^The arithmetic mean is. calculated by summing the values of all 
the observations in a data set and dividing this number tfy the total 
number of observations. Mathematically, the mean can bel expressed 



as: 



x i + x 2 + Xj ♦•••+x n 



>- n 

n » the number of elements In the data set, 
X4,X 2 »Xo £he first, 'Second, and third elements,' and 
Xjj « the last element In the data set 
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This -formula can be written in simpler form using what is called 
* the^' summation notation: , V 



n 



n 



wher©« 



X = 



n 



the m,ean f * «• 

the number of elements in the data set, 



i = 



the Greek letter slgma which is used 
to mean "the sum of," 

the subscript of data eflement X, and 
each data element 



This would be -read in the following manner':. "The meatf t)f X is equal 
to the sum of all X"'s, within the limits.1 -equals 1 tip 1 equals n,. 
divided by n." In other words, add up all the values of X from the 
first to the last and divide by the total number of'X'^s. 
HE. ' t . , ' \ • 

Tor example, suppose we wish to calculate the mean of New York 
State's automobile insurance premiums from 1950 to "1970 using the 
data in Table 4*. 6: > • 



X 

mm 

X 



69.63 + 86.98 + 108.67 ± 112.87 +' 135*60 

s . 5 - " 

^13.75 

♦102.75 ^ • 



The mean is an appropriate measure of central tendency only for 
interval or ratio level data. , 
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"~ B. The Standard Deviation 

.The standard deviation is the most widely used measure of 
dispersion. The larger its value, the more widely dispersed is the 
distribution *6f data.. It is usually greater than zero % and £an-not 
^ take a negative value.- Also, it is a relative measure of varia- 
bility. That is, it must be compared to anpther standard deviation, 
fdr a data set of nearly identical mean, to tell us anything really 

meaningful about data dispersion. 
* i 

The standard deviation is calculated by using the following 
formula: 



Sd_ = 



where x 



n 



£ (x, - x) 2 
■ j 

n 



v 



Sd x the standard deviation. 



* ' Like the mean, the standard deviation has mathematical prop- 
erties which make it useful for higher statistical operations and 
*it,is therefore N "oTten the most desirable measure of dispersion. 
- • Again, extreme sco'res may cause a problem, as ^hey are given more 
weight "when squared. However, for most large data" sets, the mean 
and standard 1 deviation are the appropriate statistics to use. 

V .The size of the standard deviation represents the extent of the 

A variability ^of individual observations around the mean. 



As ail fex.^pple, use 'the following college quiz scores to calcu- 



late the stafrd&iFd deviation: % 



24 

(-23 

21 
20 
. 20 
20 



19 
19 
19 
18 
18 
17 



17 
17 
17 
16 
16 
16 



15 
15 
15 
15 

' 14 
13 



13 
13 
12 
12 
11 
11 




I) 



0 
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It is helpful to construct a "table in which the mean differences 
can be calculated, squared, and summed. 



TABLE 4.8: Calculations for Standard "Deviation 



Test Score. 
ill 



X - X 



(X -°x) 2 



24 

23 

21 

20 

20 

*> 

19 

19 

19 

18 

18 

17 

17 

17 

17 

16 

16 

16' 

15 

15 

15 

15 

14 

13 
13 
13 
12 
12 
11 
11 



. 7.47 
6.47 
4.47 
3M 
J.k? 
3.k7 
2.47 
2.k7 
2.47 
l.k? 
1.47 
M 
.47 
.47 
M 
.53 
.53 
.53 
1.53 
1.53- 
1.53 
-«*.53 
2.53 
3.53 
3.53 
3.53 
4.53 
^.53 
5.53 

\00 



"82 



55.80 
. 41.86 
19.98 
12.04 
12.04 
12.04" 
6.10 
. -6.10 
6.10 
2.1o 
2.16 
.22 
.22 
.22 
.22 
.28 
..28 
.28 
2.34 
2.34 
2.34 
2.3k 
r 6.40 
*12.46. 
12.46 
12.46 
20.52 
20.52 
30.58 
30.58 



Standard Deviation: Sd- = 



*/ 1 



333.44 = 3.33 
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EXERCISE 4.3: Mean and Standard Deviation 

- 

Find a New York' Times article on a pub*Lc policy issue. Calcu 
late the mean and standard deviation using at least one real statis 
tic. Interpret the mean and standard deviation to make a point, 
about the public policy issue. 
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IV: MEASURES OF ASSOCIATION — NOMINAL DATA 



/ * ' 

Objectives ' - 

/ To (develop and apply a contingency table — a visual 
display of association appropriate to nominal data, 

. To calculate a statistic of association, known as , • 
Yule f s Q, .which is appropriate to nominal data, 

• » 

So far 'we have been concerned primarily with univariate 
analysis, or techniques for describing, visually and statistically-, 
single variables. The final parts of this chapter focus on the 
relationship between variables; that is, measures of association 
in what is known" as bdvariate analysis ;\These measures, known, as 
correlation coefficients , indicate the degree -of association or 
correlation between variables which are of nominal, ordinal, inter- 
val j or ratio level of measurement. Corf elation does not tell us 
about causalit-yr~but it does indicate the covariation , or direction 
4nd extent, of change that occurs^ In each 'variable when the other 
Changes. * \ 

The different correlation coefficients have a number of prop- 
erties in common: v 

. In a positive or direst relationship, the variables 

change in the same direction; that is, as one in- ■ 
•creases, the other increases or vice versa. 

In a d negative or inverse relationship,^ the variables 
change in opposite directions; that is, as one in- 
creases, the other decreases 6r vice versa. 

mese^ta±ls±ic^^^ -I'.OO to +1.00. Correla-r 



tions of * +L.00 and -1.00 indicate perfect positive and_ 
^perfect negative realtionships^respectively . 

As a general rule, the association is considered strong if the 
statistic falls between +.99 and +.60 or -.99 and -.60, moderate'if 
the correlation^ is between +.59 and +.30 or between -.59 antf*-.30, 
and weak if the\ coefficient falls between +.29 and +.001 or between 



-.29 and .001. A correlation of .00 indicates no association between 
variables. • > 

Our study of correlation descriptions and statistics will be 
limited in the following ways: # 

2 ' . ' 

We will consider only prepositional relationships, 
in which the relationship 'between two 'empirical 
variables is defined by indicating the nature of 
change between the variables and the direction of 
change. We will not concern ourselves with causa-. : 
tion, but only with whether an association of vari- 
ables exists and the strength of <tfiat association. 

We will be concerned only with* cases involving two 
variables — 'bivariate analysis. Although -many of 
these techniques are appropriate to multivariate 
analysis; where more than two variables ' are con- 
sidered, this is a more complex subject, and beyond 
the scope of this package. h 



A. Contingo*re^ Table . 

The first correlation coefficients we will explore are used 
when at least one of the two variables is nominally scaled. They 
^re also well suited for ordinal data and can even be ulsed with 
interval and rat'io data, although there are better measures of 
association for these types of data. 

Let us assume that we are interested in "testing the degree of 
association of £ex and political affiliation in*a particular commun- 
ity, and propose that "Democratic party registrants are more likely^ 
to be women. fr The determination of these variables can be made 
from public voter registration data. 

What we are looking for is the joint occurrence of two condi- 
tions: female sex and Democratic party affiliation. This implies 
that we might expect another joink occurrence: male sex and Republi- 
can party affiliation. In fact,, four joint occurrences are possible: 

1. Female ^sex and Democratic party affiliation. 

2. Female sex and Republican party affiliation. 

3. * Male s$x and Democratic party af f-iliation. 

4. Male sex and Republican party *af filiation . 

Our proposition says that we expect outcomes 1 and 4 to be^ high, and 
outcomes 2 and 3 to be row/ . v w 
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A means for visually -iwW. ^Pg^™^ 
comes is called the contingency table.. The general lorm 01 

tingency table is Tab}£ 4.9. • 

• , TABLE 4.9: Contingency Table-. , 



• 


*X 






» 


(a) 


(b) 


a + b 


(c) 


(d) • 

( 


c + d 


a + c 


b + d • 


n 



\ 



X and Y = the presence of the prepositional conditions, 
X* and I' = the absence^of the prepositional cpnditions, 

« b c and d « the -conditional frequencies Khich indicate , 
a, b, c, ana a * ^ number- of Joint occurrences of XY, 

XT, XY\ and^X'Y*. 

a ^ c b and b J'd « the marginal frequencies *hich are the number 
r anu . . of individual occurrences of Y,. X , X, ana 

X*. and 

X • f £ ' 4 

\ n « the total number of joint occurrences, 

• — * a + b + b + J?.'. • . * . 



Using hypothetical 'data, we' construct a contingency table 
for association between sex and party affiliation. 
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?ABLE 4,10: . Association of Sex and Party . Affiliation 



Democriat 



Republican 



v Female 


Wale ; * 




a 


D 




157- 


17 




- • c 






• 23 


.136 / 


159 


. 180 


,153 


333 



This table yields a great 
the variable^ and their degree 




eal of* empirical fhformstt £dn- about 
association: 



1. 



* The sum of the conditional frequencies, or frjie sum 
of the vertical or horizontal marginal' frequencies r 

'tells us that n, the total number of party affllla* 
tions, is 333* \ 



2. 



3. 



4; 



The marginal frequencies tell us that .of the total, 

there are 174 Democrats and 159 Rejfublicans r and 

that, there are 180 women and 153 men. Thus, there 

„ is a slight majority of women and Democrats. * 

The conditional Ns &requencies # tellnis the numbter* of 
joint occurrences in each cell. For example Jr there ' 
are 23 females registered as 6 Republicans. 

,It is evident from the distribution of conditional 
frequencies- that our proposition is supported by the 
data; of the 180* female registered voters, most .of 
them, 157, are Democrats. Conversely, the vast 
majority of mep, 136 out of 153, are Republicans/* 
These data indicate a strong, positive .association 
between women and Democratic party registration. ■ 



In contrast, consider the following table,, in which v the marginal 
frequencies remain the same but the conditional frequencies have* 
changed: - 
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sociation of Sex and Party Affiliation 



Peinale 



Male 



Dembcrat 


01 


\ 83 


"-3 

~174 






>»■ . 


* * 


• 

Republican • 


✓ 89 \ 


* 


159 




" '180 


'153 


335 


• -' 

v, 


\ • 


* 


4 



In this distribution of outcomes, it is difficult, to support any 
proposition regarding association between two yariables. Indeed, 
these data indicate that they are independent o£^one another. 

The contingency table gives us an idea of the association * 
between twb variables." It allows us to- identify positive associa- 
tions, in which the a and d cells are', dominant .^negative associa- 
tions, in which the b and c cells are dominant; or no • association , 
in which the conditional frequencies- are all .about equal or *re pro- 
portional to each other, for example:** ' 



50 
10 



20G 



40 



"In constructing a contingency table/. use the form shown in Ta*ble 4.9* 
and remember to state the proposition in the title of the table and^ 
to cite the source of your data. , * 



B. Yule's Q 



y 



r 



In most cases, it is desirab2fe to obtain a numerical *estimat-e of 
association, A statistic which will provide this function/ for y 
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nominal data is Yule's Q .'* Although Yulejs Q has certain limita- 
tions, it does provide^ an^ approximate measure of association which 
^is* preferable to the intuitive impressions available from the con- 
tingency table.' 

Yule's Q is calculated directly from a contingency table as 
follows: - ' 



Q * 

where i 



ad - be 
ad + be 



Q = Yule's Q 



a, b f Cf -and d « the value of the appropriate cell In the 

contingency .table and, 



ad and be « the cell cross-products. 



* 

Using Yule's Q, we can calculate estimates of association to verify. 
Vthe conclusions, in, our sample contingency tables. The calculation 
Vox* Table 4.10 would be: 9 * 

- ad - be (157) (136) - ^(23) (17) 

Q » ad + be 25 (157) (136) + (23) (17) 

- 21352 - m: 20961 

^21352 + 391 " ^217^3 #9 

This statdstic shows that there exists a strong, -positive' *c*>rrela- 
tion between female sex' and Democratic party affiliation, which 
reaffirms our previous conclusion. " The calculations for Tabid 4 11 
would be: . y • . * 

*:„ '(91) (89) (83J 6370 - 7387 ' . - 

*. ' (91) m) + (89) (83)V. * 6370 + 7387 

. ""13737 * 



*There are a number of other frequently used statistics which are 
similar to Yule's Q« These include Chi Square and Gamma. For 
further information on these statistics, see J.M, Blalock, Jr., 
Social Statistics , New York: McGraw-Hill, Inc., 1972. , * 
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This statistic, being practically zero, indicates that aimost^no 
association exists. 

Y.ule's Q is an appropriate* estimate of association when you 

desire' a statistic which gives a quick approximation of association 

and its direction, and your dat^ are arranged in a, two-cell byv 

two-cell contingency table. / 

« 

However, keep in mind that Yule's Q lias limitations: since it 
includes only conditional frequencies and not marginal frequencies, 
it is regarded as only an approximation, and, if any cell is zero, 
the statistic cannot be calculated because the result will always be 
equal to 1. . - * « 



EXERCISE 4.4: Contingency Table and Yule's Q 

Using a recent New York Times articled/construct "a contingency 
"table and calculate Yule's Q. Use at least one real statistic; the 
rest can be hypothetical. Make a meaningful interpretation by using 



ERLC 



policy issjue. * \^ 


4- 




' - Y ' . ^ 




ft 








* \ 1 


• 

• 




• . • . /'V v 


1 


*^ 


■ ■■' A 


r '■ 












/ .. 






t . • 

* 1 * £ 



120 



/ 



V; ' MEASURES OF ASSOCIATION INTERVAL AND RATIO DATA 



Objectives 



To develop and apply the scatterplotf , which is a 
visual display of association appropriate to interval 
and^ratio data. 

To differentiate between linear anc 
association. 



curvilinear 



To calculate Pearson's r, a slcatistic of correlation 
appropriate to interval and ratio ijata. 



Interval scales, you will recall, contain all 'the properties, 
nominal and ordinal scales, plus information about the absolute • 
size of* thQ interval between data elements. , On £his scale, we cah 
determine not. only ^that one element is larger than, another , but 
also how touch -larger. Thus, the mathematical techniques off addition 
and subtraction are' possible with the§e/ scales . 



Ratio 



absolute 
addition 
meaningf 
another. 




res a$J? like interval scales except they" contain- an 



>rb,poiirr which is lacking An' the £nt<ervatl scale. The 
>f this feature means that^atips between intervals become 
il. We <*an now say th\t c5ne element is twice as large a^ , 
The mathematical techniques of multiplication and division 
are possible with these gcales. . ; 

. . * -7 
The use* of these two types of scales allowslus to employ still 
more sophisticated measures of association, such as the scatterplot, 
wh ( ich is a visual technique for describing data association, and * < 
Pearson's x, a statistic for measuring the degree of correlation 
between interval- and ratio-scaled variables. 



A. .The Scatterplot 



r 

,A scatterplot, or diagram is simply a graph in which om? vari-< 
able is scaled along .the Y (or vertical) ; ax^s and^the other -is scaled 



i 

it 

h ..- 

Mr; 

:RJC 
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Figure 4.6: Scatterplots 

Y 



X- 

Perfect, Positive Association 
Y 




4 Perfect, Negative Association 0 



No Association^ (Beoause the Y 



variable does 



not vary) 



Positive Association 




Negative Association 

Y 



No' Association* 



X > 



136 Ho Association (Because the X 
-Tariahle does not vary). 



7 r-^ 
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along the X (or horizontal) axis^ .Pairs of values can then be < 
represented • as points orj the grSph. The pattern or "scatter" which 
the points describe suggests types of association of the variables, 
as shown by the graphs in Figure 4.6/ 

' ■ ■ • • 

The following information indicates the test scores of ten 
students on a quiz in a social science course, and* their respective 
grade point averages. We are interested in determining whether there 
is any association between the two variables." 

■ « • € 

TEST SCORES ANB" GRADE POINT AVERAGES 



ERIC 



i 



Student 


Test Score 
X 


Grade Point 
Average 

Y 


A 


19 


2.9 


B 


lh 


2.3 


C 


21 


3.5 


D 


12 > 


2.1 


E. 


2k 


3.8 




19 


2.7. 


G 


20 , 


3.r* ! 


<•»- . H 


16 


2.7 


I 


23 


3.6 


J 


17 


2.6 




t0 





/<■ 



I, 



Using these data, we ca'rf construct a scatterplot: 
'Figure 4.7: Scatterplot of Test Scores and Grade Poin.fr Av<*rag&S 
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You will- note that the points tend to line up from .lower left to 

upper right. This tells us that "as test score increases, grade • 

point average increases." We already know that this kind of a 

« prepositional statement defines a positive association. . 

Thus far, we have- graphed only, situations' in which both vari- 
ables have been positive. However, it is possible, particularly , 
in working with ratio scales, to encounter negative values for 
variables. Population growth ratesj^an be negative, and government 
budget balances and corporate earnings can be negative -or deficit, 
as spending exceeds revenues.. Thus,, our graphing techniques must 
allow for an expression of these values. Figure 4.8 extends the 
X and Y scales into the negative to create a graph which is actu- 
ally composed of four quadrants.- We have only dealt with Quadrant 
I thus far. The other three quadrants are defined in terms of their 
positive and negative attributes. 



Figure 4.8: Signs of X ajjsUY in Four Quadrant Coordinate System 

+Y 



-X 



( 



Quadrant II 



X negative 
Y* positive 



X negative 
Y negative 



Quadrant III 



Quadrant I , 



X positive . . 
Y positive, \; 



+X 



1 



X positive 
Y'-negatlve 



Quadrant IV 
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Depending upon the values of the variables, a scatterplot may 
fall into any of the four quadrants or any combination of quadrants, 
The conclusions, based pn the shape of the scatter, will remain the 
same regardless of the quadrant involved. 



B. Pearson f s^r — The Pearson Product-moment Correlation 
Coefficient ; 



Pearson's r is a correlation statistic, appropriate to interval 
and ratio scale data. It varies from -1 to +1 and the ' interpreta- 
tion of the scores is the same as with Yule's Q. 

G 

It is possible to-^express Pearson's r in a form which is easy 
to calculate: 



where i 



<£X)(£Y) 




r * Pearson's r 

n*= the number of paired observations being 
tested for N assoclatlon, 

X and Y « the pitlred variables, and each^ttmmatlon 
!s for the 1st through nth term. 



Using this formula, the calculation o'f r for the, test score/grade 
point average data, is as follows: 
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TABLE 4.12: Worksheet for Pearson *s r — 



-Test Score /GPA ^ata 



2.-9 
2.3 
3.5 
2.1 
3.8 
2.7 
3.1 
2.7 
3.6 
2.6 



19 
14 
21 
12 

,24 

19 
20 
16 
23 
17 



8.41 
5.29 
12.25 
' 4.41 
14.44 

7.29 
9.61 

7.29 
12.96 
• 6.76 



Y 2 


XY 


361 


55.1 


196 


32*2 


441 


73.5 


144 


25.2 


576 


91.2 


361 


' 51.3 


400 


62.0 


256 


43.2 


529 


82.8 


289' 


44.2 



ix=29.3 2y=185 ix 2 =88.71 ^Y 2 =3553 *XY*560.7 



r = 



560.7 - 



(29.3)(185).' 
10 



88.71 - 



(29.3)' 
10 



3553 - 



(185) 



10 



q 



. 560.7 - 542.1 



-^(88. 71 85.85) (3553 - 3422.5) x 



18.6 



7^(2.86) (130. 5) ' 
. 18.. 6 ? 



"V373.23 ' c 
1.8.6 " 
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There are several factors that may affect the size of 



Pearson's r: 



1. Because Pearson's r is related to tlie mean, if you 
have' one disprepant pair of observations (e.g., if 
one observation is high on x and its counterpart %s 
low on y) in a set of data that is otherwise posi- 
tively linearly related, the calculated correlation 
will ,be iower than what is truly representative. 

2. a Similarly, if the majority of data pairs are nega- 

tively linearly related and one pair is positively 
related, the magnitude of the observed linear rela- 
tionship will be lowered according to the observed 
statistic. N 

3. If the variability of the relationship is too limited* 
-Pearson's r will automatically decrease. For example, 

in the following diagram the boxed-off area represents 
extremely homogeneous data which does not usually indi- 
cate, a high correlation. 




4. 



If one or both- distributions are skewed,^ the magnitude 
of the Pearson's r will be reduced unless they are 
skewed in opposite directions by the same amount. 
In that case, Pearsan<*s r will increase. 
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EXERCISE 4.5: - Scat'terplot "and Pearson's r 

Choose a recent New York Times article on a public policy 
issue. Using at least one real* statistic, construct & scatter- 
plot and calculate Pearson's r. Make a meaningful interpretation 
by using the display t.o make a point about the public policy issue, 
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CHAPTER FIVE: POLICY EVALUATION 



r 



THE PRIMARY. OBJECTIVE: 



This chapter will introduce the student to the concepts 
and designs*used to* evaluate social programs'. 



•UPON COMPLETION OF THIS CHAPTER, YOU JSI-LL BE ABLE TO:' 

* Identify the benefits and costs of a public policy 
or social program. » 

i 

* Recognize the need for systematic evaluation of 
social programs. 

s • 

* Identify various designs used for the evaluation 
of social programs. 

* Distinguish between poorly designed and well-designed 
, evaluations of social .programs. 

<'* ' „ 

* Select the most Appropriate design, given H the social 

program, available resources, as well as constraints 
of time, ethical considerations, and "potential user 1 3 
interests. * 



(Based on PS-11': Designs for Evaluating Social Programs , Lawrence 
P. Clark* Croton-on-Hudson, NY: Policy Studies Associates, 1976.,^ 
and a forthcoming learning package by Josephine LaPlante. )* \ 
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I : AN INTRODUCTION .TO THE USE OF BENEFITS AND COSTS OF 

PUBLIC POLICY c ' 



The need for cutting costs at all levels of government has 
focused much attention on the quantitative techniques which are 
available to assist decision makers. Benefit-cost analysis is a 
tool which can help decision makers to evaluate alternatives to 
determine whether a project should be undertaken and at how large 
a scale. Benefit-cost analysis need not be a difficult procedure 
and it is. one which is suited to both personal as .well as public 
decision making. 



A. • Defining Benefits and Cost's 



Benefit-cost' analysis seeks a systematic evaluation of -all 
benefits and 'dosts of a particular project. What is a benefit? 
What is a .cost? 

Benefits are anything you gain by undertaking a par- 

* * ticular course of action • 

• , " Costs are anything youmust give Up in-order to obtain 

* those benefits. a 

Thus, costs are not-oo-ly-a- direct monetary outlay^ but should also 
be thought of as benefits which must.be foregone if one alterna- 
tive is chosen over another ; This measurement of costs in terms 
bf benefits which must be sacrificed* is what economists call an 
opportunity cost . 

Oppor£un±.ty_costs._ are ^inherent in all decisions. When aS> 

government decision maker. chooses to implement one program rather 

.ttffanl- another, 'he .Is sacrificing the* benefits which could have been 
derived from- the next best us^of the funds. When implementing 
a- new program requires raising taxes, there is an opportunely cost 
involved «Ln removing resources from the use of businesses and house- 
holds. When you make the decision to purchase a record album rather 
than a book, "your opportunity cost equals the benefit you" might have 
derived from reading the book. 
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Benefit-fcost analysis attempts to entimer^te all such benefits 
and costs' and then assign values to them. This is where the major 
♦problem of benefit-cost anad!ysis arises. How can you determine 
how much reading a book is worth ~to yofr? The answer depends on 
various factors. If the book is a required text, the opportunity 
cost of choosing an album over the book might be quite high. On 
the other hand, the benefits you might derive from a record album 
could t?e even higher. 

There are several techniques jfor. assigning values to benefits 
and costs, but they are not without controversy. At this point, 
the major idea to keep in mind- is, that all decisions entail costs 
and, benefits and a systematic approach to considering them can 
, greatly improve decision making. 



B. An Informal Application of Some Benefit-Cost Concepts 

The -decision-making rule of benefit-cost analysis is simply 
that which common sqnse dictates: 

A PROJECT SHOULD BE UNDERTAKEN ONLY IF ITS ' 
BENEFITS ARE AT LEAST EQUAL TO ITS COSTS,- > . 

With this rule in mind, let's look at 'a'hypothetical situation and 
attempt to use benefit-cost analysis to help make a decision. 

r 

John, .a graduating senior, has been planning to 
attend graduate school to obtain a Master's degree 
in Pjiblic Administration. He has just been offered a 
position at a public agency *where he has been working 
as ati intern. The position offers a good starting 
salary and various fringe benefits ^including a tuition 
reimbursement program for cotfrsework related to the job. 
There is also room for advancement Mthin t the agency. 
However, John believes that he , would have been offeree! 
a more challenging position if he'd tiad* a Master's degree. ' 

What are' the benefits and costs which John shouid consider? What 
are the* benefits he can hope to obtain by investing a year's time 
in attending graduate sqhool? What are the costs, including < any 
benefits* Q!Tthe job which he'll'have .to turn down -to attend 
school? , - - j ' • 18* 

• There are a number of benefits and costs. Let us* look at 
some of them; 
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Benefits 



Costs 



Potential Higher life-time ' 
earnings 

Sense 'of satisfaction^ * 
Prestige 

Increased knowledge 

Improved job-seeking status 

Benefit to society of better 
educated citizenry 

The decision is not- a simple one, 



Cost of tuition, fees, books 
Loss of earning! from emploj^jpnt 
Loss of tuition 'reimbursement - 



Loss of # year's wortH of experi- 
ence* f ' * 



C. 0 Classifying Benef j 



X 



ke benefits and^sts outlined in the education 
6 e . seemed more pertinent , than others. Some of the 



§ome oj 

example may iw^- ^^ v ~ *~ t> , - ■ , „. 

'more 'import an? Benefits or costSs Inay Tiave been harder to define. 
Benefits and co$8iJE$L.l in,to two :ca^egories , direct and indirect, 
depending on theilw^^Lation ,to. the particular project being 
analyzed. "Direct aiM^ndlrec^ benefit s,and cbsts may each be 
divided into tangibl¥#ersus .ifclfffgible,. efii eets . Whether an effect 
is 'tangible or intangible- depen^'s lb the nature* of the benefit or 
cost itself. Let's look-put thfe e plassif ipattions more carefully. 

Djrect benefits and costs fre fthe^i^mary ef f ects ol *a given 
alternative. Indirect benefits Wid' costs are the secondary effects, 
or "side-' effects" which occur becausep^f a project. Examine the 
benefits and costs outlined in the Education example in this frame- 
work: 



Benefits t 



Costs 



DIRECT 
INDIRECT 



Increased earnings 
Benefit to society 



Tuition charges ^ • 
Loss of leisure ' ' 



Direct and indirect -benefits and costs, a^e either tangible or in- 
tangible. A tangible effect is one which may be quantified. While 
tairgfble effects of projects can be xspedif ied in monetary terms, 
m it is often.' difficult to assign'a value which can be generally 
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agreed tipon.* In the above breakdown, both the direct l^ensfit of 
increased earnings and the direct cost of tuition charges are 
tangibles «and could be expressed in monetary terms. In a flood- 
control project, an indirect tangible benefit might be reduced soil 
erosion; an indirect tangible cost might, on the other hand, be. 
increased soil erosion. 

An intangible project effect is a benefit or cost which is non- 
monetary in nature. Both the indirect benefit and the indirect cost 
noted above, benefit to society, and loss of leisure are intangible 
effects. Examples of direct intangible effects' might be the same . 
as those mentioned for indirect, given a different situation where 
they would be primary ^effects rather than secondary. As noted ift 
the initial breakdown, whether a benefit or cost indirect or in- 
direct depends on its relation to .the particular project under con- 
sideration. Whether benefits and costs are tangible "6r intangible 
is determined by the nature of the benefit or cost itself • 



XEB£ 



EXERCISE 5.1: Benefits and Costs - 1 ^ ■ ' 

Find a recent news article or editorial which discusses a 
particular project or public policy ajld tell whether the policy is 
proposed or existing. Cite a source and give a brief history of 
the policy, including where it was proposed, approximate date of 
^proposal or passage, and the area the policy will affect 4 " (local, ? 
state, national). What are the expected costs and benefits of the 
policy? ■ ' fc , 
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II: THE 4 NEED FOR RESEARCH DESIGN 



, When' a program is implemented, there are certain expected - 
benefits and costs. The^egree to which these benefits are realized 
and the costs minimized is a measure of the degree to which the 
program succeeds. For example, if a program is designed to pro- 
vide reliable mass transportation for a small community, and the 
transportation is expected to reduce fuel ^consumption, reduced fuel 
consumption is an expected benefit. If fuel consumption is reduced 
the program is, to some^egree , . a success. But if. the amount of v 
fuel saved is veyy small/ and the cost of the mass^^ran sit system 
vjery* high,, the program may be considered a failure. Jfn this case, 
the desired benefit Was achieved but the costs far outweighed the 
benefit^. / 

Unlike a laboratory /situation, th€f policy* pnviromnpnt cannot 
be isolated. The transportation system cbu]$ have faljLed to 
improve. for many 'other reasons. Perhaps fuel consumption did not 
decrease because although, people were using their cars less for 
intracity travel, they were using them more for intercity travel. 
Perhaps people took more vacations. Perhaps fuel prices fell during 
the trial period so that it became cheaper to drive than to take 
the mass transportation. All of these factors could have made the 
project- look like a failure. 

* * • * 

Social scientists have developed ways of making observations 
systematic so, that the number of alternate explanations for the 
impact of the program is minimized. With these methods, the ex- 
pected costs and benefits of the policy can be observed more readily 
With minimal interference from other sources. ' It is these research 
designs that will "be examined in the remainder of this chapter. 

To illustrate why it is not satisfactory to evaluate any 
given social program without constructing a systematic plan to 
collect and evalua'te data, consider the following example. • 



Suppose that you felt ill on Monday, visited the health 
setfvi.ce on Tuesday and received a one-day supply of fcills to 
alleviate the problem. On Wednesday you' feel *f ine. You. are then 
asked Jay the physician whether you feel better. You tell him, 
"Yes, ^truthfully.' Assume f of simplicity that, in fact, your ¥ 
health status lias improved. - 
r • ; . * ■ 
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Based on this simple comparison of your condition before 
receiving the pill versus after, the physician infers tht the pill 
has "worked," i.e., that the treatment's effects were positive. 
The size of the effect is gauged from the size of the improvement 
in health status' from the following graph: 



HEALTH 
STATUS 



good 



. bad 





before after 
THE PILL 



steeper the slope from A to B, the greater the improvement in 
health status. 



SEXfHcQISE 5.2: ' Benefits and Costs in Evaluation 



How do your ekpected benefits and costs relate to the success 
or failure of your program? What cost or benefit will you study? 
What 'is the purpose of your design? 



m 



o 
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Ill: SOME BASIC CONCEPTS NECESSARY TO UNDERSTAND 
TYPES OF RESEARCH DESIGNS - 



Regardless of/design, all attempts at evaluating the impact 
of a-social program consider at Least the following seven basic 
concepts. / o " 

( l\ * 
1. Dependent' /Variable ,4. Confounding Variable 

. , 2. Independent Variable 5. * -Subjects % * 

3. Manipulation , 6. Control 

7 . Randomization 

<v rt isj possible that you are familiar with some or all of these 
concepts* 'For that reason, you should rfcad only those sections of 
this part unfamiliar to you. * 

Th^. material in this part is presented in a glossary format. * 
.The concepts are applied throughout the remainder of thip chapter, 
and the^jmrpose here is merely to make sure that you hav6 a general 
comprehension of what they 'mean. 



A. Definitions 

4 * 

1. Dependent Variable 

The dependent variable- is the fact which tHe researcher, is • 
interested/ in explaining. , It may be the math ability of high" 
school students, the fluctuations in the oil, market, or *he effects 
of compensatory education on preschoolers. In the pill-taking 
example the dependent' variable is the change in your healttp status. 
In all cases r the aim is' to explain why, a variable behaves the way 
it does. 7 
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2. Independent Variable 



{ 



The independent yariable is the variable used to explain the 
one that is dependent. * It is usually thought of as being causally 
prior to the dependent variable. In the study of compensatory 
education, th.e independent variable could, be the type of education 
presented to the preschoolers. In the pill-taking example, the. 
4 independent variable is the pill. ^ # ✓ 

3. * Manipulation . 

. Manipulation occurs when an experimenter can intentionally 
create variations in the independent variable. These manipula- 
tions could be different approaches to teaching preschoolers or 
the race of the teacher. In the pill-taking example, one manipula- 
tion could be the strength of the dosage used in the pill. Another 
manipulation could be the type of drug used. 

4. Confounding Variable • . . . . 

• ... ■*"■-« 

* Confounding variables are the rival explanations .for the 
behavior of the dependent variable. The difference in the amount 
of learning by preschoolers may not be due to different approaches 
to teaching but to factors outside the classroom such as. home 
environment, nufober of siblings, etc. In the pill-taking example, o 
the improvement in health may be due to changes in eating habits, 
. more- sleeg, or any of a host .of alternative explanations. 

5. Subjects # 

Subjects are t the units upon which the observations are made. 
Tl^ey may include 'the individual preschoolers, nation-states, formal 
organizations, or government agencies. In the pill-taking example, 
you 'are the subject upon which the observations are made. 

6. Gontrol • ^ 

i ■ There i3 within every 'evaluation either an explicit qr implicit 
comparison: that "some collection of subjects is better or worse 
as;ji result of the evaluator's treatment or manipulation. The 
octroi is that set of data with which the treatment group is 
compared. The control can be another collection 'of subjects not 
receiving the treatment, or it can be a series of measurements 
taken on the treatment group before.it receives the treatment. 

» *. *r * > 

7 . Rand omisation ^ * 

' : ^ * x 

. «* 

Randomization is the .process by which subjects have an equal 
chance of being assigned to either the treatment group or the 
control group. , The group they end up JLn is determined purely by 
chance. % . «•* . , 
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EXERCISE 5,3: 4*pplying the Definitions 

\ State tfie independent and dependent variables for jtour design ♦ 
The dependent variable should be clearly measurable. 
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IV: RESEARCH DESIGNS 



A. Pre-experimental Designs 

£v ( * The first three^designs to be considered are called Pre- 
/^^Kre^imental Designs; As one can gather from their names, they 
( alge not>true experiments., Since they are not, they lack the basic 
power of & true experiment to show what causes what. It is this 
power which, underlies the inferences made by the evaluator abo\it 
c the effectiveness of the social program. To the degree that a 
research design increases that power ,>lt increases the strength of 

* the inferences derived by the evaluator.' The three designs are: 

One-Shot Case Study, One-Group Pretefet/Posttest , and Static-Group 
Comparison^' 4 

VIn presenting these and the other experimental designs which 
follow, the code and graphic presentation developed by Campbell and 
'Stanley will be used. An X will refer* to the exposure of- a group 
to an experimental treatment or event, the effects of which are to 
be measured in some fashion; An 0 represents a process of observa- 
ton ^or measurement- The X»s and O's in a given row are applied to t 
the same people. or groups. The left-to-right "dimension symbolizes 
the temporal" order, in which events occur. The X's and O's on top 
of each other are simultaneous occurrences. The symbol R stands 
for the, random assignment of subjects to separate treatment groups. 

- This' randomization occurs at a specific time and is the general 
procedure used to bring about pretreatment equality of group's. The 
graphic presentation of parallel rows not separated by dashes 
represents comparison groups equated by randomization, while those 
separated by 'a dashed line are comparison groups not equated due 

" to JLack o¥ random assignment. 

■ One-Shot Case Study 

• - In this design, a single group is studied only once- after , - 
^"^being exposed to some treatftpnt which is presumed to cause a chartge 

in the dependent variable. The diagram of such a study is: 
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These studies have 'such a total lack of control as to be of almost 
no value to the evaluator. Fortunately, one almost never sees this 
kind of design reported in the literature on program evaluation. 
The design is discussed mainly as a jnlnimum starting point. Under- 
lying all program evaluation is the process of comparison, of noting 
differences, or, of -contrasting the changes in the dependent variable. 
For such comparisons to be of some value, the things being compared 
^should be observed with equal care. In. this design, a thoroughly 
studied single case is implicitly compared with what would have 
.been had the-X not occurred. Studies using this design often collect 
copious amount of data on the treatment group in order to buttress 
their conclusions. However, these tvp^ es of studies suffer from 
what Campbell and Stanley call the error of 'misplaced precision' 
since' this potentially vast amount o/r^a^a-io-Hitf way compensates for 
lack of an explicit comparison with some other group or set of 
observations. The One-Shot Gase Study is the weakest design to be 
considered here, and is even less complex than the pill-taking exer- 
cise discussed below. ' ^ ' 

One-Group Pretest /Posttest 

This is the design used in the pill-taking exercise. In gen- 
eral, the design looks like this? - — -~ 



0, x o 2 • 

At 0 , the pretest, you observe that you are not feeling too well. 
You go to the health center for the pill treatment, X. One day 
later at 0', the posttest, you notice an improvement in your health 
status. FSr the discussion of this design and the ones that follow, 
a small change in the pill-taking example^ will be made. Assume 
that -from now on you are part of a larger group of people given the 
same drug. This change is done for statistical reasons. The pill- 
taking ^example will be used to illustrate the strengths and weak- 
nesses of this design. * ^ 

There are several confounding variables which threaten the 
internal validity' of this design. These confounding variables- 
offer rival explanations to the hypothesis that X was responsible 
for the difference -between 0^ and 0 2 



One of these uncontrolled confounding variables is history. . 
Betweeti the pretest 'observation and the posttest observations, many 
other change-inducing-events could have taken place besides the 
experimental treatment. After a winter of drab and depressing days, 
the-sun might have come bursting out with all its warmth on the day 
that you went down to the health center. Thus, the reason that you 
feel better may be due to the beautiful day rather than the pill 

- .:, * 154 
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you took. In order to be a*reasonable rival hypothesis, the "event 
should have occurred to most of the people in the group. History 
becomes a. more credible rival hypothesis for explaining the change, 
the longer the lapse between the pretest /postt est . 

While this design is a weak one, it is an improvement over the 
One-Shot Case Study, 

Static-Group Comparison 

Suppose the health center compared the results of your treat- 
ment group with another group of students. Such an evaluation 
design is called a Static-Group Comparison. In this design, a 
group which was exposed to treatment X is compared to one which was 
not. This comparison is made to establish the effect of X. 



o, 



! 

The hope is that the two groups will be equal and thus a valid 
comparison ca& be made. 'Unfortunately, there is no formal way of 
confirming that the groups would have been equivalent had it not 
been for the treatment X. This problem, indicated by the dotted 
line, highlights the major confounding variable not controlled by 

this design — selection. If 0^ and 0^ differ, this occurrence 

might well have happened because different criteria we're used to 
place people in one group or the other-. Thus, the groups would 
have differed even without the Experimental treatment. Selection 
could be a problem in the pill-taking example if the health center 
put all the sick people in one group and at the time of observation 
Og,; selected an equal number of- healthy students as the comparison 
group. Since one would not expect all the sick people to be 
completely cured, the health center might .falsely conclude that the 
drug did not have an effect. In fact, this would not be- the case 
since there is no reason to assume that the two groups were equal 
had it not been for the taking of the pill. 

Pre-experimental Designs:' Conclusion 

The research designs discussed^in this sectiop are the weakest 
of the designs used in program evaluation since they do a very poor 
job of controlling rival hypotheses as explanations of the change 
in the .dependent variable/ In the next section , /three designs 
which do the best job of controlling rival hypotheses will be 
considered. \ 
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B. True-experimental Desigiye- — 

i. 

Unlike the previous designs, the next three. are True-experi- ' 
mental Designs. The basic difference between the three types is. ^ 
the amount of control the evaluator can exercise. Within the 
context of the design, the evaluator can not only schedule the ^ 
collection of data, he or she also has Some degree of cotftrol Qyer J < 
the presentation of the independent variables. Through the ability 
to randomly assign subjects to, treatment or control, the evaluator 
can cut down the number of potentially confounding variables which 
could be used to cast doubt on his results. The ability to control 
these factors provides a strong inferential base from which to draw 
conclusions. 

The three* designs are: Pretest /Posttest Control Group, 
Solomon Four-Group, and Posttest-Only Control Group. These three 
designs, as Campbell- and Stanley point out, are those currently 
•recommended in the methodological literature. They are also^the 
most highly recommended designs presented in this chapter for the 
evaluation of social programs. However, as will be pointed out 
later, there are some specific limitations in the use of each of 
^hesed^si^ms-wnd^^^ -Of- the - 



three,, the Pretest /Posttest Control is by far the„most popular, 

Pretest /Posttest Control Group 

Su ppose the health center, in an attempt to find ou t, the 



effects of the drug, randomly assigned sick students to one of two 
groups: an experimental group which wi^l receive the drug, and a > 
control group which will receive no treatment. Assume, for Jhe 
purpose of illustration, that the health - center would take the 
unethical stand of withholding' treatment from patients. Both 
groups are given a pretest, 0 1 and 0„, at the same time. The 
experimental group then receives the^treatment and the control group ^ 
receives none. After the treatment is completed, both groups are 
given a posttest, 0 and 0 , at the same time. The general form 



of the design is as, follows 
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R 0, X 0 S 
R .0, 0. 



History as a confounding variable is controlled since any 
general events that might have caused an 0 ± -0 2 difference would 
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have also caused an Og-CK difference. However, you should be aware 
that this design does not control for unique intrasession history, 
i.e., a car accident happening in the street outside, a momentary - 
power failure', etc., which occurs while the treatment is being 
given. The best control method for such problems as thie randomi- 
zation of experimental occasions. The studetnt should try to bring 
about a balanced representation of such possible sources of error 
as type of experimenters, time of day, week of the semester, etc. 

Using this evaluation design, you would not have to worry 
about fhe consequences of £ sunny day since' both the pill-taking 
group and the Control group would be equally affected. 

Solomon Four-Group 

Suppose the health center was concerned about the threats to 
external validity noted in the previous design. It decided^ to run 
the Pretest /Posttest Control Group Design -again with the aAition 
of two more g^pups/ # Now students would b.e .randomly assignS&to two 
other groups, in addition to the two groups from the previous v 
design. One group ^ould be given the treatment and the posttest 
with no protest. The other group would be given only the posttest. 
— Again, it will fre. assumed for purpose of illustration that the 
health center would withhold treatment from patients. The design 
wpuld look like this : 

«■ . - 



R 


o, 


X 


0 2 


R 






o. 


R 


* 


X 


o 5 


R 









The first two groups replicate the Pretest /Posttest Control 
Group Design-. Thus, this design ha£ the same power to control for 
alternate explanations as that design. Thie addition of the two* 
extra groups allows the Solomon Four-Group Design to control for 
more alternate explanations not controlled for in previous designs. 
In this way, the generalization of the results is increased. To . 
illustrate, using. the" pill-taking example, suppose the drtig had no 
effect and the reason you got better was the fact that you were^ 
examined by a doctor. If this is the case, then Og and 0^ should 
be greater than Qe and 0 fi . If not, then" we know it was not the 
pretest tj*at caused the change in 'your health status. Now suppose 
the. change is due to 1 an interaction .between the pretest and the 
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drug. For. this to be true, 0 2 has to be greater than CL. If Hh^t 
is not true and you did in fact .improve your health status, then 
this design provides solid proof for the efficacy of the drug. 

Poettest-Only Control Group 1 

V 

There are n^any situations confronting a program evaluator for 
which pretests are inconvenient, likely to be reactive, or inappro- 
priate. If that is the case, the Posttest-Only Group Design should 
be considered.^ While it is not likely that a hospital would give a 
patient a pill" without a prior examination, let us^ assume for the 
moment that this could ' happen as part of an evaluation program. As 
the students came to the health center, they would be randomly 
assigned to' one of two groups. The first. group receives the treat - 
nfent and a posttest examination. The other group jus*t receives the 
post test examination. The design looks like, the following: 



R • X O, 

R - 

V • ' .< 

While the i£ea of a pretest to determine the comparability of 
groups is an old and cherished tradition in research, it is not an 
absolute necessity for True-Experimental Designs. Within the 
limits of a statistical confidence, the explanation of which is 
beyond the scope of this chapter, the randomized placement of 
subjects into the various groups is a most satisfactory way of 
assuming that the groups are initially equal. 

Since the/two groups are assumed to be initially equal, this 
design has the same control over alternate explanations as have 
the y other two designs in this section. 

True-experimental Designs: Conclusions ' ^ ^ 1 

' «* V 
By far the most popular of the three experimental designs 0 is 
the Pr et.es t-/Postt v est Control Group Design. The Solomon Four-Group. 
Design is the jnosV comprehensive of the three, put that increase in 
comprehensiveness comes at the cost of at least double the effort. 
In terms of the actual 'cost of the evaluation, ' the Posttest Only 
Control Group Design is £he cheapest to run. 
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C. s Quasi-experimental Designs 

The next three designs fall somewhere in between the Pre- 
experimental Designs of Section £ and the True-experimental "Designs 
of Section B. ^There are many natural situations in which the pro- 
gram evaluator, for ethical, political, or practical reasons, cannot 
randomly .assign subjects to groups or control who receives treatment 
and who cfoes not. However, the evaluator can follow something like 
an experimental design in the collection of data even though she or 
he does not have the full control over the independent variables - 
that makes a true experimental design possible. Such collection * 
procedures are called Quasi-experimental. Designs, The three 
designs 'to be considered are: Time-Series, Nonequivalent Control. 
Group, and Multiple Time-Series. ' ■ 

/ ( >: '' r' 

Time-Series * 

Since the withholding o.f treatment is morally wrong, the health 
center might want to turn to a Quasi-experirrfental Design to # e*taluatfe 
the efficacy of the drug. Suppose that it measured the indivldukl' 
health status of a group of students over an extended period of„; 
'time. During that time, students periodically re|(orted to the ' 

health center for an examina tion^ At some point iff this series oi § 

examinations, the health center gave, the drug to the students. T t he 
design would look like the following: ' . * • 



. 0, 0 t 0, 0 4 X0 S 0* 0 7 O e • • 

Basically, the Time-Series Design' contains a series of observa- 
tion's or measurements on a group or individual and the presentation 
of a treatment manipulation into this time series.- The results of 
treatment are indicated by a discontinuity in the observations made 
during the time series. ^ % . . ^ 

Figure 5.1 represents some of the likely resulj^g, for a time- 
series design into which* a treatment, X, has been p^sehted to 
the subjects. It appears from. Figure 5.1 that the* treatment had 
some impact in the case -of A anti B and, conceivably, in the case ot 
C, D, and E. It would not appear that the treatment had any impact 
in the case of F, G, and H. ' • 

1 The most obvious weakness of this design is the problem of 
history. There may be some event external to the treatment session 
that caused the change in the dependent variable. To the degree 
that you can reasonably discount such outside events as causing 
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Figure. 5. i: Potential Impact of Treatment on Time-Series Data* 



TREATMENT 




roT) ; o 2 o 3 < S 



♦Adapted from Campbell and Stanlev (1963)-. t 
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the change in the dependent variable, you -increase the strength of 
the inferences made from the experimental results. As was noted -in 
the. One-Group Pretest /Posttest , this design is susceptible to the 
confounding influences of a sunny day which might occur at the same 
time the health center gave you the pill; x 

Nonequivalent Control Group 

* 

This is one of the most popular Quasi-experimental Designs for 
program evaluation. Suppose that the health center wished xo use 
two different dormitories as subject pools ftrn its study concerning 
the effectiveness of the drug.. All the students are given a pretest 
examination and later a posttest. In between tests the experimental 
group is given the pill". The design would look, like the following j 



0, x o 2 



, In general,, this design consists of an experimental and control . 
group whose equivalence has not been assured by the random assign-' 
meht of subjects to the groups. As much as possible, the evaluator • 

^tries to find^ groups that are as similar as availability permits. 

It is assumed that the evaluator has. control over which group 
is. presented with the treatment and. th^t assignment is "random. * This 
design should not be confused with the Pretest /Posttest Control 'Group 
Design. 'In the present design, the subjects are not randomly 
assigned to groups from a comr|jfc population. ~The more comparable 
the experimental and- the control group are in terms of recruitment 
and scores on 'the pretest, the more powerful this design becomes. 

4 

Multiple Time-Series 

Suppose that, in addition to. the time-series data collected 
for the previous design, the health center corresponded with another 
university health center and asked it to collect a similar time* series 
without the treatment, X, being presented. The basic design qbuld 
be diagrammed as follows: 

. QACkQ.xOgQAq, 

Q,0 w Q n 0 a .Q 8 CUQA > 
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In essence,- this design is a combination of the Nonequivalent Control 
Group D^ssLgn and the Time-Series Design. In most evaluations of this 
type, eVaPuators obtain their data from a similar institution which 
is not exposed to the treatment . 



The design contains within it t&e strengths .of the two previous 
Quasi-experimental Designs. In addition, any change in the dependent 
variable caused by the treatment is confirmed twice, first against 
the control group and second "against its own pre-X observations. 

Quasi-experimental Designs: Conclusions 

The*Multiple Time-Series Design" is the best and most highly 
recommended of the Quasi-experimental Designs. ^While all the designs 
have certain weaknesses, tftey should be usefrNffr* program Evaluation 
.where circumstances preclude the use of the stronger True-experimental 
Designs. 



EXERCISE 5.4: identifying Designs 

e « 

Under. each of th» three sections below — Pre-experimental 
~£>es4gnsT~- True-experimental Designs, and Quasi-experiment al De sign's 

read the four brief evaluation statement s' and deteTWin^-wh-i-cti-of- 

the designs best describes the approach of the evaluator-. Identify 
the various components of the evaluation using the Campbell and 
Stanley notation in justifying your description. 



Part 1. Pre-experimental Designs 

T. A countywide campaign against child abuse is carried out. over 
a period of six months. ' At the completion of the campaign, 
the county supervisors compare the rate of child abuse in their 
county with the rate for the neighboring county. On the basis 
of that comparison, they conclude that the campaign was a success. 
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.A Federal agency, observes ,tliat the crime *ate is increasing^ 
It supplies the local law enforcement departments with massive 
amounts of Federal aid. A year liater the agency notes^ that the 
increase -in the crime rate is less than the previous year. The 

ag o ncy oonclud o s that — massive~aid-4x>- local police departments 

helped decrease the rate of crime in the 'country: 



**&n after-school program to increase the reading level of "minority 
studenta is begun At the end of the school year, the reading 
level of the ^children in the program /is JLower than the (rest of 
the ''children in the school*. The principal concludes th&t the 
program' .was " a wagte of money and resources. 
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4. A local city council is concerned about the number 'of bicycle 
- thefts which have occurred. It institutes a program to get 
everyone to .lock their bicycles. One' month after the proj 
the number of bicycles^stolen is reduced. The city council 



~euirc~tuaes "fla?t the program was a success. 



Part 2. True-exper ^.mental Designs i4 

1. A locai city council is concerned about drug use among. teen- 
agers in the city. The council wants to know if* live speak- 
ers are effective in changing the teenagers 1 attitude toward - 
drugs. It is arso interested in finding out if this pre- 
sentation is more- effective tlianTio presentation at all. All 
the local high school students a*e tested about their attitude 
toward drugs. They are then randomly Assigned to one of the 
two conditions outlined ab^e. . After .being exposed to one of > 
the two conditions, all the students are- again tested about 
their attitude" toward drugs. 
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A local police department is interested in finding out if role>- 
playing.is an effective method for teaching crisis intervention 
techniques* Police officers are randomly a^i^ja^d-to one of 
tfco' conditions. ^Onegroup^ and 
Jtb^e^i^^test^iT A second v group receives no additional train- 
ahd is juit tested. 



/ 



Patients in a mental^ hospital are randomly assigned to one of 
the following conditions. In the first group, the patients 1 
social interaction in the dining room .is observed* at the be- 
ginning of t£e month. They are then given a therapy program 
designed to increase their social interaction. At the end 
of the month, their behavior in the dining room -is observed 
again. In the second group, the pati'ents are given the same 
therapy program as the first group. At the end of the month, 
they too are observed in the dining room. The third group is 
observed in the , dining room at the 'beginning and at \the end of 
the month. The fourth group of patients is observed in the, 
dining room at the end of the month. 



/ 

151- 



4. A local high school is interested in Evaluating a new .slide- 
• *c tape program concerning driver education. The students are 

randomly assigned to' one of two conditions. In the first con- 
* ditidn y the students do not see the slid^tape show. The 
second group watches the slide-tape presentation. After the 
slide-tape presentation, all of the students are given a 
o questionnaire concerning driver education.. 



i 



Part 3. Qjias^-experimental Designs ' * 

P 

1. Children at two different day-care centers are tested for their 
verbal abilities. After the test, a program designed to im- 
prove verbal skills is begun at one of the centers. At the 
completion of the program, the children in both centers are 
-tested again. 'J 



r 
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State legislators, concerned over the yearly increase in 
traffic deaths during tjie previous f ive years, passed a 55 
m.p.h. speed limit. During the -four years after the law wae 
passed, the yearly increases were reduced. The legislators 
conclude that the 55 m.p.h. speed limit was responsible for 
the change in traffic fatalities. 



The county police department has noticed an increase in the 
number of arrests for driving while intoxicated during the 
past three years. They conduct a three-month program aimed 
at reducing the number of drunk .drivers on the road. For 
three years ^fter the program, they collect data on the 
number of drunk drivers arrested in the county. At the end 
of the second three-year period, they ^compare the* number of 
drunken drivers arrested during all of the preceding six 
years with the yearly, arrests of drunk drivers for the satae 
six-year period in a neighboring county. 
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4. A university library is concerned about the number of books 
which have .been stolen in eacl^pf the past four semesters * 
The library personnel develop Tew checking-out procedures, 
V The number of stolen bOQks is recorded each semester for the 
next three semesters. At the end of thq third semester, the 
number of stolen books has treen reduced. The library adminis- 
tration concludes that thq program was a success. 



r 



EXERCJSE 5.5: . Research Designs/ * . . . 

Part 1. What research design will you use? Discuss the- diagram 
V associated with the design . Be specific about the source and 
method of data collection. « 



\ 



Part 2. Why did you select this, design over the others? Discuss * 
this with respect to monetary costs, feasibility , ^availability 
,._/"^ information, and length of time of study. 

r 
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V: THE QUESTION OF VALIDITY 



After you have selected the proper design, collected the data, , 
and reached a conclusion about .whether or not the program had the 
intended effect, you still need to address the question of the 
validity of the results. By validity, we mean whether ar not your 
findings are "true. 11 Millions of words have been written about 
the nature ,and meaning of truth, and it is impossible in this section 
to deal with the serious philosophical* problems associated with the 
question "how do we know truth." However, it is possible to look at 
a study- and identify the considerations that might render a particu- 
lar result untrue. In the social sciences, we never determine truth 
definitively. We merely eliminate as much as possible the factors 
that might bias the results of our findings. 

The chart below presents a starting-point in assessing the 
validity,, of findings that might, come from a given study. On the 
•columns we ask the question "did the study find the program success- 
ful/" and on the rows^e ask the question "was the program, really 
successful." When you are in the process of designing the study, 
analyzing the information, and, reaching conclusions, you need to 
keep in mind the two questions posed by the lower left-hand and upper 
right-hand boxes. These are: 

1. If my data show that the program w&s successful, what 

„ factors could have shaped the data even though the 

program was not in reality successful? 

2. If my data shtfw that the program was unsuccessful, what 
factors would have shaped the data even though the pro- 
gram really did have the intended effect? 



Considering Factors That Render Program Evaluations Invalid: 

Results of Study . . . 



— Rea-l-i-ty- 

r 
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Program Works 


Program Does Not Work 


Program Works 


' Valid 


m Invalid 


Program Does 


Invalid 


Valid" 


Not Work 
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To illustrate how you might take into consideration questions 1 and 
2, let us assume you are studying the implementation of a curfew on 
the drinking of alcoholic beverages at parties in a university 
dormitory-.^ If you conducted a study and found less vandalism 
attributable to drunkenness after the policy was implemented than, 
before, you might conclude that the policy worked. However, you 
would need to deal with such questions as did the general level of 
drinking among college-level age groups decline after the policy 
was implemented; did the amount of vandalism outside the -dormitories 
(that is T in the local bars) increase"; did the price of alcoholic 
^beverages increase; did the weather get better so that students could 
play outside more than they could prior to the implementation of the 
policy; or did the policy itself not have the impact, but the pub- 
licity given to alcoholism and vandalism stimulated by the policy * 
make the difference.' " *• * 

Similarly, if the study showed that vandalism due to alcoholism 
did not decrease (either stayed the same or increased), the conclu- 
sion that the. policy did not work would not necessarily be yalid. 
Such factors a§ an increase in the number of rowdy alcoholic students 
on campus, the relative inexpensiveness of alcohol as a form of 
entertainment (it's almost cheaper than ice cream), the increase in 
the number of students in dorms, the reduction-of-the-supply-of-drugs, 
or reduction in the number lof bars in the university areas could have 
caused an increase in alcohol-inspired vandalism* in the dorms. The 
program may -fiave had the effect, of not allowing these factors to 
increase alcohol-inspired vandalism but the findings .would indicate 
the policy* was a failure. , ^ U 

All of these factors could render your conclusions invalid, and 
it is impossible to eliminate, the effect of all of them on your- find- 
ings. What you need to do is* to recognize that they exist, construct 
your .research design so that as many of these factors are controlled 
for in one way or another, and identify the- problems when you write 
""up jrour .'results. On top o'F tfiese" coTraiderXtlbDiS , we need also to 



up your resuiis. uu lu±j ui wicoc ouuoj.uci»i-j.uuu , — — 

point *out that the data themselves- may a not represent what they are 
supposed to. In many pases, .bow you measure the effect of the policy 

-is open to debated/In ou"r university alcohol policy illustration, 
for example, how information is collected on the amount of alcohol-, 
inspired vandalism could seriously,| affect the results of the study. ( 
Those keeping the records could over-report the amount of vandalisms 
depending on whether .or not they support the policy. The procedures 
for determing whether or hot vandalism is caused by individuals* under 
the influence of ■ alcohol is open to "question. If the total amount of 
vandalism — ra'ther than that inspired by alcohol — is used, the 

-amount-of vandalism could increase or decrease irrespective of the> 



use of alcohol. 

The question of validity, then, is clearly essential to consider 
_ in ^designing a program evaluation and reporting its conclu^S^on. .While 

ERIC 
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it is impossible to reach a firm conclusion that a given finding is 
valid, the research must always seek to •reduc'e as much* as possible 
the source of factors that render the study invalid, , .To ignore 
these sources is to produce a study of little use, * ' 



lEXERCISE 5.6: Validity 

Discuss how the study might have produced positive .results for 

reasons other than that the program haH wnrk^H _ Discuss hn w th e 

design might have produced negative results for reasons other than * 
that the program did not work ; Discuss how your data^may not repre- 1 
sent what they are supposed to. 
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CHAPTER" SIX; ANA^ING POLITICS WITH THE PRINCE 
POLITICAL ACCOUNTING SYSTEM 



T 



J 



THE PRIMARY OBJECTIVE: 

This chapter is an introduction to the PRINCE Political 
Accounting .System*. m ' ^ 



UPON COMPLETION OF THIS CHAPTER, YOU WILL BE ABLE*TO: 

* Identify the actors involved in the formulation and 
implementation of a given public policy , *< 

»^ . ■ 

* Gather information on the factors shaping -the behavior 

of the actors toward that issue w 

* Interpret those factors through the PRINCE Political 
Accounting System so that alternative politic^L^.rategies 
can be assessed. J ,<0? 

> l - ^ 

' ' ' ' ' \c 

(For a booklength discussion of the PRINCE System see: William B. 

O Poplin arid .Michael K. O'Leary, Everyman's PRINCE; A Guide t o Under- 

ERJC standing Your Political Problems . 2nd ed. ,. North Scituate, MA: 
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I : INTRODUCTION 



The PRINCE Political Accounting System is a technique for 
assessing the, impact of various individuals, groups, and organiza- 
tions on public policy decisions. The basic assumption betibjid^the 
PRINCE System is that in order to assess the impact 'of relevant indi 
viduals, groups, and organizations on any decision, it is necessary 
to do the following: , 

Identify the individuals, groups, and organizations 
(the "actors' 1 ) that are likely to hav^ a direct or 
indirect impact 6^ the decision. This includes those 
that have a formal role in the making or blocking of % 
the decision. It also means including th^se-who have 
an indirect impact — those making it either easier or 
harder to carry out, a decision after it lis made. 



DeternHng whether each actor supports, opposes 1 , or 
is neutral toward the decision. (This is called" 
"issue position. ") 

"Determine how effective each actor is in blocking 
the decision, helping make it "happen, or effecting 
the implementation of a decision. (This is called 
"power.") 

Determine how important the decision is to each 
actor ^ (This is called "salience.") 



When 'making decisions, key individuals — the President, a 
legislator, a regional governmental official, a business executive, 
a school superintendent, or the head of the househpld — always 
perform these kinds of analyses, if only informally. The purpose 
of the PRINCE System is to provide a systematic framework and check- 
list which decision makers can use to make sure^they carry out the 
kind of analysis required to assess the consequences of a decision. 
The PRINCE System also aids decision makers in organizing their 
staffs and making use of knowledgeable observers. 
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II. STEPS IN COMPLETING THE PRINCE SYSTEM 



Tne basic steps ' follo w ed in completing Ike PRINCE Sy srtrenT are 

shown below: * 



Step 1: Define the Issue 

An issue is a proposed decision or action which is likely to 
generate controversy. It may be a local ordinance, 1 a national policy 
decision, or an international foreign policy issue. The PRINCE 
System can be applied when the proposed decision is clearly defined 
in specific terms, in a phrase beginning with a verb. If an issue 
is defined as "pro'tecting the environment-" or "improving the 
efficiency of an agency's regulatory procedure," it would not be 
possible to complete a PRJNCE Analysis*. But 'the analysis can be 
done on specific issues such as "issue, a general regulation control- 
ling the landfill activities of private landowners." The key is 
found in the verb used to p>tase the decision. Verbs such as "pro- 
tect" or "improve" are undesirable because they do not adequately 
specify the r.equired action. Verbs like "restrict^" "vote," 
"oppose," "permit," or "build 1 ; are much|more useful. 

While decisions or actions need t6 be, specif ically defined in 
orde.r to conduct analysis, trying to guess '"at the exact detail of 
the 'final formulation is not required. One of the main character- . 
istics of reaching decisions affecting* many aotors is that the action 
• is frequently redefined and modified as a result of the process of 
reaching a decision-' The decision may begin as ".issue. a general 
regulation that governs landfill activities of, private landowners" - 
and become modified to "issue a general regulation irhat governs land- 
fill activities of private landowners and commercial property under 
a certain acreage." Such a change may be required' to obtain the 
support of important groups ^to solve, technical problems in adminis T 
teririg the permit. The PRINCE System can be applied^to any^^imber 
of proposed decisions (including redefinitions and modif icjations) as 
long as it is clear what specific action is involved at each poiri-f 
along*- the way.. . > N ~ 

» ' Another important consideration in picking a decision is to mafie 
sure that there is both significant. support and opposition. It is^ 
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pointless to analyze a decision that is either so well accepted or 
so widely opposed that the outcome is obvious. Of course, few 
decisions aftecting the public result in overwhelming support or 
opposition. However, when they do come alopg they do not "need to 
be analyzed systematically. 



T 



Step 2: Identify Actors 

An actor is any_ individual , group^or organization that ought 
to be considered in making the decision or^in carrying it out after 
it has been made. Reasons for including an actor are any pf the /v 
♦ollowing: The actor has substantial legal authority; the actor has 
political^inf luence to 'promote or obstruct the decision; or the 
actor will be seriously affected by the decision and may either help 
or hinder its implementation, even though it may not have much of a 
say in the actual making of the decision--^. 3 v * 

Identifying the actors to be considered is one of th^lmost 
important steps in the PRINCE System. Omittinfcg an important actor 
or incorrectly grouping actors can distort the Analysis so much that 
the analysis becomes useless. 

In order to keep the analysis within feasible bounds, limit the 
number of actors to 20 — or even less, if possible. In situations 
where time is short, try to limit the number ^of actors to 10 or iess« 
The reason for limiting the number of actors *is to limit the time 
required for listing and calculations required for the PRINCE 
Systeiu^ ^ 

The principal way to- limit the number of actors is to group 
individuals and organizations into collective actors for the purpose 
oi analysis. The process of grouping frequently appears arbitrary 
and, as mentioned earlier, can seriously bias your results if it ,is 
not done carefully. However, there are some guidelines that will 
assist you in grouping actors to Jielp improve the accuracy of your 
analysis: * t * 



Group actors together that hav'e the same economic 
interests. In dealing with an environmental issue, 
for example, all private developers might be grouped- 
tog.etl^ft for this reason. 



w . Do noi^^poup together actors that have, veto power. 

This especially holds for governmental actors. For 
example,^ the U'. S. Fish and Wildlife Service might be 
v • * kept separate from the Environmental Protection Agency, 
• but .similar, State Agencies (Natural Resources and 

^ Environmental Regulation) could be combined. 

*> 
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. Do not group together actors j.f there" is, disagreement 
among them of if their components have widely unequal 
power. \For example, a city' government could be com- 
bined as a single actor if there were general agree- 
ment among all members of the government concerning 
the issue and it. each person in the governing unit had 
approximately equal power. If there were disagreements, 
or if some nfembers were much more powerful than others,, 
it would be preferable to divide them' into two (or 
more) actors. ^ 

~ Select a configuration of actors that taken together 
constitute a reasonable picture of the overall power 
> distribution. Do not include an excess of actors that , 
gives one side an unrealistic weighting. ^ If there is 
one collective actor with an immense amount of power, 
that actor should be* divided into enough smaller actors 
so that the total power configuration 4s accurately 
reflected." >/ 



These guidelines are admittedly quite general. The designation^of 
the actors in the PRINCE System is at least as much an art as a 
science. Your judgment in conducting the analysis is vital at 
every step. In one sense, 'this might be viewed as a weakness in 
the technique, but not really. " The system *is a way of organizing, 



ignore the importance of judgment and balanced insight (even if it ~ 
werfe possible to do so) in the selection of actors as well as in 
the other aspects of PRINCE analysis. 

Step 3: Estimate Issue Position » Power, and Salience for Each Actor 
.(See Table 6.1), 

-Issue Position is the currenjt general attitude of Vhe actor 

toward the decision. It is expressed as a number ranging^! rom ^ . * 
to -3 to indicate whether or not the actor supports (+3, +2, or T 
+1), is neutral toward (0), or opposes (-1, -2, or -3) the decision. 
A "+3" is assigned if the actor is firmly in favor of the issue^and 
is unlikely to change; "+2" or "+1" indicates reduced levels of firm- 
ness of the actors support. Similarly, a M -3" indicates firm Oppo- 
sition while a ,! -2" y or, . "-1" indicates there is some softness* in the 
^opposition. € j 

Power is defined as the degree to which the actor can exert 
influence, directly or indirectly, in support of or in oppo sition 
to the decision, relative to all other actors . The basis of - an 
, actor's power as well as the ways in which this power may be exer- 
ciser are varied. Power, may be based on such factors as group size, 
wealth, physical resources, institutional authority, prestige, and 

r " — — — ■ * - — — 
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T^TABLE 6.1: 
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political 'skill. Power is expressed as a number - ranging fronri to 
3. A "1" is assigned if the actor has a slight amount of powe*r a 
"2". if the actor, has moderate power.' "A "3" is assigned if an afctor 
has substantial influence, especially if the actor can veto 6r pre- 
vent the implementation of the decision. ^ 

Salience is defined as "the importance the actor attaches to 
supporting or opposing the decision relative to all other decisions 
with which that actor is concerned. Salience is expressed as- a, 
number ranging from 1 to 3. A "1" indicates slight interest orT con 
cern for the iss>e regardless, of the issue position or power. A^ 
"2" is assigned for those actors that have moderate concern. 
^rrevefseSTfor those actors that assign the highest pri-orityfTTo^prh 



issue. 

The task of estimating each actor's issue position,* power, and 
salience can be facilitated by -the following suggestions. 

When estimating an actor's issue position: 

. Read and listen to what the actor says about the 
issue. > * * - . / 

\ 

, . Deduce from the actor's economic, sqcial, or political 
standing what its position is likely to be on the 
basis of self-interest. * 

. Weigh the implications of concrete interests against 
what it Ijas said. When in doubt, use concrete 
interests for ^our estimate ov^r mere verbalizations. + ^ 

* Look for differences among individuals and factions 

within a collective\actor . Look for inconsistencies 
\in statements. by an Individual actor T If^the contra 
ing positions seem evenly balanced, assign a "0" 
(neutral) a issue position. If tfoe^e seems a slight 
--- positive or negative' b^aricre toward i:he issue^, assign 
a "+l n or "-1" tor the*actor'S issue position . 

When estimating an actor's power ; ^ f} 

. A'sk if the actor has the resources-wither to block a 
decision or to make one occur. . \ 




. Determine if legal authority • is a consideration and 
if the actor possesses a large sfcare of the authority . 

Consider whether an actor has the ability to help or 
hinder the carrying out of a decision. .(This is why , 
*** constituency groups have power.) * 
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• Determine, if wealth is a consideration, how much wealth 
the actor has. 

* 

. Do not assume that an actor powerful on one set of issues ■ 
\\\ ,# is necessarily powerful on all ^issues. It is true that 

'an. actor's high power on one issue means" it may have power 
on other issues, but it does not assure high power. 

. Consider the allies and enemies of the actor. Powerful 
allies makes the actor powerful; powerful enemies diminish 
the actor's power. 

When estimating salience : ■ 
♦ 

^ Determine the frequency and intensity with which the actor 
^ makes public statements about the decision. " 

. Deduce from the adtor's social, political, and economic. 

interests the importance it is likely to attach to the * 
* decision. 

■ <■ . 
. Watch out for the fact that 'salience can be rapidly and 
substantially altered "by external events and the- intru- 
sion of , other issues. 

9 Remember • t^bat o*ther decisions and factors compete for the * 
actoa* f s .attention and, hence, its salience. A, > 

Like selecting actors, the assignment of issue position, power, and 
salience is something of an art. Systematic research can play an- 
important, role, but the importance of' the skillful 'assessment 'of 
existing conditions by, .knowledgeable, and sensible observers is abso- 
lutely essent i'al . Therefore, ' it? is important that those completing' 
the charts be thoroughly familiar with the situation. They should 
talk to other knowledgeable people and gather all available informa- 
tion on the reactions of individuals, groups, and organizations to 
the proposed decision. 



Step 4; ^ Calculate .the Weights for Each Actor and for the Whole .System 

\v A^ter the estimates^ are made for £ach actor,, the next-step^is 
to calculate the weights each, actor contributes in the* decision. This 
is done by multiplying, issue' position times .power times salience for 
each at6tor. Issue position /(alone of the three variables)* may be 
-either- positive;- or negative.' (The other two are always positive.) 
Therefore,^ the' sigtf of ithe issue* posit ion will be the sign of the 
"weight for each actor After each actor's weight is 'calculated, 
determine the .overall, sum by adding tire, signed numbers. (See Table 
6.2:) 
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Step 5: Calculating Probabilities 

By completing the following steps, the weights calculated for 
each actor pan also be used to 'estimate the probability of the 
decision* s being adopted. * 

1. Add together the scores of all the actors supporting the* 
decision. Call this total "A." 

2. Add together the scores of all the ^ctors oPDOsin^ the issue. 
u • Eliminate the minus sign. (This is called taKing the "abso- 
lute value" of the number.) Call this total "B." 

3. Multiply the nonzero scores of all the actors that have a 
neutral issue position, and add together these scores. Call 
this total "C." < 

m 

4. Add together' "A, " "B," and "C". This is the total of all the 
power weights in the particular system as you have described 
it with your PR INGE analysis. Call this, total "D." 

.5.$ Add together ,f A ff and on.e-hal-f the value-of VC," the neutral 
actors' scores. Call this total "E. M -The reason for includ- 
ing one-half tha value of ft C !l is thfct the neutral actors are 
equally likely, in the future, to^be either supporters or ' 
opponents of the issue. Tiife besJt way to represent this v: ,v 
50-50 situation in the absence, of bther information is to 
include just half of the neutral actors 1 scores with the 
positive weights. Total "E M is the sum of the best esti- , 
mate of the likely weights to be exerted iti support of the 
. issue. > # m ~ \ * 

# 6. Divide "E 11 - (the weights supporting thfe is^) ; ^y "D 11 (the 

total weights In the system.)^ The ^resulting'* raction is pro- . 
portion of" positive weights in relation to the total weights. 
It can be interpreted as the likelihood that the v issue\w,ili * 
be supported — that the decision, law', or whatever ^s 
represented by the issue, will be implemented. This frac- 
tion, like all probability numbers, ranges from 0.0 (no 
chance of occurrence) to 1.00 ( certainty. of occurrence) . 
These numbers are frequently reported as 0% t& lyffiy- %m ^pt&^ 7 :'~*] 
that'll the N .probabilityv-ia;:low^i . this may mean two things: 
either the decision will t>e defeated, or it will continue 
as a controversial issue without being decided one way or 
another. The closer the supporting aiid opposing weights 
are to. each other, the more likely the issue will continue v 
as a controversial tbpic without being resolved one way. or 
anothef. • 

Table 6.2 has a completed PRINCE chart on the issue/of maintain- 
ing pres'ent tuition rates \x>x the next academic year at a university. 
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TABLE 6.2: .PRINCE 'Chart 

ISSUE: Maintain the Same Tuition Cost from 1980-81 to 1981-82 

(State in terms of a desired political outcome 
using a -phrase beginning with a verb;*) 



y 
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ISSUE 
POSITION 
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* TOTAL SUPPORT 
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Totals 4. ~ Scorers, of all actors supporting the issue: 
B' Absolute value of actors opposing the issue 
' . C - Scores of actors with zero issue positions: 
D - Totals A, B, C: 50 - «.« 
E - Tfl^al A + 1/2 of Total 'C: 12 
♦ Probability of Support = E = 12 = .24, (24%) 1 

D • 50 



10 
•« 36 
4 



y 

J 



er|c 



Note that the students and the representatives of the parents are in 
favor of maintaining the present levels. yThey havB a weight of 10; 
this is total "A." The administration, tne general faculty, and the 
faculty senate budget committee are opposed. Their scores, total 
"B, M have an absolute value of 36. 'And Vhe boardof trustees is 
neutral; their sc<?re, total "C," is 4. The^ total scores of all the 
actors (counting the product of the nonzero' scores for the board of 
trustees) is 50. The total of these in favor of holding the line on 
tuition is 10; to' this is added 2 points (one-half of the score of 
the neutral board of trustees") for a tota^ of 12, total "E." The 
basic PRINCE calculation, then, is "E" divided by TT D , 12/50,, or only 
.24 — also expressed as a 24% chance that the present tuition rate 
will remain the same for the forthcoming academic year. InCrbher 
words, this forecast indicates the chances are quite small that the 
rates will 'remain the same* 

You should note 'that this analysis could have been prepared by 
having the issue states as " Raise tuition rates for the forthcoming 
yeai{. " In this case, the signs of the Issue p9sitions w£uld he 
reversed. The resulting calculations .would have been: Based oifc a 
total of 36 points for those supporting an increase*, plus 2 points 
for the'neutral board of trusteed, for a total of 38 divided by 50, 
for a probability of 76% that the increase wo.uld take ft&acre. Saying 
that there is only a 24% chance that no increase mil occur i? the 
same as saying that there is a 76% cl^ance that an increase will occur. 
(Incidently, the increase did occur, confirming the unhappy predic- 
tion.) It is a matter of convenience whether the issue' is stated as 
affirmatively, making an action occur, or negatively, preventing an 
action from occurring. 
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EXERCISE 6.1: Conducting a PRINCE Analysis 



Identify a public policy — either one existing or one pro- 
posed — and conduct a PRINCE Analysis to determine whether or jiot 
fthe policy will continue iif it already exists) or will be 'imple- 
mented (if it is proposed). Complete each of the first five steps 
outlined* in this section on the PRINCE chart bel£w. 

(State in terms of a desired political outcome 
using a phrase beginning with a verb.) 
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Totals:* 



o/ 




A - Scores ot all actors supporting 'the issue: 
B - Absolute, value of actors opposing the issue: 
Cv- Scores of actors with zero issue positions: 
D - Totals A, B, C: 

E - Total A + 1/2 of Total C: ■ ' IS'J ' 

Probability- of Support = E = ; * : + 

,% 1 D 
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Step' 6: Strategies 

One of the prime values of the PRINCE Political 'Accounting Sys- 
tem is that it enables you to formulate on a systematic basis strate- 
gies tljiat you might want to pursue to achieve* a political outcome. 
In ord4r to use the system, the first thing, that you must decide is 
what political outcome you would like to achieve. In tetfms of the 
probability estimate generated by your analysis, do you want' a higher 
or lower probability? Once you have decided that question; you need 
to take -the rdle, of one of, the actors in the PRINCE chart or to take 
a role that you can visualize would. allow .you to influence actors in 
the PRINCE chart. . 



• * 
After making a decision on what your political goal is and whom 
you will represent, you can explore strategies under the following 
principles: , a 

i 

1. Formulate your decision so that you get the most important 
components of what you want, while making potential oppo- 
sition actors as happy as possible. 

2. Try to stimulate actors who are not on the PRINCE chart 
to become interested or powerful enough to warrant plac- 
ing them on the PRINCE* chart. 

3. Change issue position of actors so that they agree with 
you , or if they already igr.ee with you, more firmly agree 
-with you. This can be done by: 

a) Using arguments of a symbolic or factual kind 

b) Making promises 
e) Making threats 

d) Establishing friendly relations with or becoming 
- 'enemies of those wht> 0 are the enemies Of the actors 
whose issue positions you .wish to. change. 

„. 

4. Change power of yourself and those who support you relative 
to those who do not support your position by: 

^ a) Gaining wealth 

b) Improving your organization to deliver votes, money, 
of other expressions of support <e. g. letters to 
Congressmen)* * * & 

c) Acquiring knowledge and expertise > • H * 

d) Making friends 

e) \ ; Isolating enemies. 

5. Change salience of yourself and those who support *ou relative 
*tc? those who do not s^uppoi*t your position by: 
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a) Raising salience: 

i) Create an event^'that generates publicity 
11) Distribute information about the issue, £ 

b.) Lowering salience: 

i) Keep issue out of the press or 'other publicity 
media 

ii) 1 Raise another issue that deflects attention of 
' ■ actors whose ^salience you wish to lower. 



EXERCISE 6.2: Using Strategies 

' Choose the role of one of the actors from the PRINCE chart 
completed in Exercise 6.1 and 'develop two strategies to raise the 
prbbability of your desired outcome. 



• If* V 




